Max level shown:
1 [ Aug 26 21:26:19 Enabled. ]
2 [ Aug 26 21:26:19 Rereading configuration. ]
3 [ Aug 26 21:26:19 Rereading configuration. ]
4 [ Aug 26 21:26:21 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:1::1]:5353 --dns-address [fd00:1122:3344:1::1]:53 &"). ]
5 [ Aug 26 21:26:21 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-08-26T21:26:21.069ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:1::1]:53 }
92026-08-26T21:26:21.070ZINFOdns-server (store): opening sled database path = /data/dns
102026-08-26T21:26:21.093ZINFOdns-server (store): pruning trees for generations newer than 0
112026-08-26T21:26:21.093ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-08-26T21:26:21.093ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:1::1]:53
132026-08-26T21:26:21.093ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:1::1]:5353
142026-08-26T21:26:21.224ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29296, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:16485 req_id = 83bd8a8f-2c88-422b-bdbe-9ce60e0a53a4
152026-08-26T21:26:21.289ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:1::2]:52753
162026-08-26T21:26:21.290ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = f384e45a-e449-460a-9e1b-0501ebf66cc6
172026-08-26T21:26:21.290ZINFOdns-server (store): pruning trees for generations newer than 0
182026-08-26T21:26:21.311ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
192026-08-26T21:26:21.311ZINFOdns-server (store): updated generation new_generation = 1 req_id = f384e45a-e449-460a-9e1b-0501ebf66cc6
202026-08-26T21:26:21.311ZINFOdns-server (http): request completed latency_us = 21561 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:1::2]:52753 req_id = f384e45a-e449-460a-9e1b-0501ebf66cc6 response_code = 204 uri = /config
212026-08-26T21:26:34.394ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21382, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:44544 req_id = b6a71e4e-0bf6-4f66-b5ee-af0f562d9db8
222026-08-26T21:26:34.399ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19885, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:51032 req_id = 5d07e179-11ca-4a81-893d-84d0df2cdda4
232026-08-26T21:26:34.404ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35666, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:55174 req_id = 819258ea-36f9-41e1-95dc-8173fc3b1bbe
242026-08-26T21:28:58.379ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58955, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54186 req_id = 6e8c9e08-5d41-433a-891e-bc7bba417c47
252026-08-26T21:29:08.327ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19312, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56861 req_id = 42bffd71-839e-457f-af78-6105bde93b11
262026-08-26T21:29:08.415ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10145, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), ), original: Query { name: Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 101, 102, 97, 55, 53, 99, 54, 45, 50, 98, 53, 97, 45, 52, 55, 51, 102, 45, 57, 56, 56, 102, 45, 51, 57, 49, 99, 50, 53, 49, 51, 97, 57, 49, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913." peer_addr = [fd00:1122:3344:101::e]:39239 req_id = ce128d0d-4829-444d-b032-ad5e4149c0fd
272026-08-26T21:29:08.439ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10145, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), ), original: Query { name: Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 101, 102, 97, 55, 53, 99, 54, 45, 50, 98, 53, 97, 45, 52, 55, 51, 102, 45, 57, 56, 56, 102, 45, 51, 57, 49, 99, 50, 53, 49, 51, 97, 57, 49, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913." peer_addr = [fd00:1122:3344:101::e]:41151 req_id = 8e749f70-2680-49df-91f9-fd0fa693ae5f
282026-08-26T21:29:09.150ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40861, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:3787 req_id = 34a71280-56bd-4681-80a0-2d6f46dc5e41
292026-08-26T21:29:09.353ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40576, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:61705 req_id = ada0aec5-1955-440b-ae58-610be7a4ef59
302026-08-26T21:29:09.604ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34358, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:5229 req_id = c2632cbf-f055-4819-ba9a-3166a99baa0f
312026-08-26T21:29:18.329ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2657, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55932 req_id = aeb66735-e900-4ffc-ad7d-342e4b117b2c
322026-08-26T21:29:28.331ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40209, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:62208 req_id = 91bbf878-5395-468c-9743-2d9fac408bac
332026-08-26T21:29:38.333ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59661, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:58930 req_id = 97dd5708-ae6f-4b74-aad7-c939ceb7a0a1
342026-08-26T21:29:39.443ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24846, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:8939 req_id = daeba711-473f-4cd9-92b5-efe7a4dbc1e4
352026-08-26T21:29:39.843ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:59090
362026-08-26T21:29:39.894ZINFOdns-server (http): request completed latency_us = 22351 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:59090 req_id = 02f3877f-559e-4b6c-9acf-b1744d8226b9 response_code = 200 uri = /config
372026-08-26T21:29:42.121ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:49024
382026-08-26T21:29:42.122ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = cfb6b01a-1d57-49aa-972d-faa3694682d9
392026-08-26T21:29:42.122ZINFOdns-server (store): updated generation new_generation = 1 req_id = cfb6b01a-1d57-49aa-972d-faa3694682d9
402026-08-26T21:29:42.122ZINFOdns-server (http): request completed latency_us = 265 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:49024 req_id = cfb6b01a-1d57-49aa-972d-faa3694682d9 response_code = 204 uri = /config
412026-08-26T21:29:42.418ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38097, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:2529 req_id = c9d79e70-0573-4a88-9223-98cf17059841
422026-08-26T21:29:42.731ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:54958
432026-08-26T21:29:42.731ZINFOdns-server (http): request completed latency_us = 235 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:54958 req_id = 068c46f8-ec09-42df-90ed-150f7b644ef5 response_code = 200 uri = /config
442026-08-26T21:29:43.918ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2845, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:24284 req_id = b2475121-2d4d-47ad-89cd-81e28d75f592
452026-08-26T21:29:44.068ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:58603
462026-08-26T21:29:44.068ZINFOdns-server (http): request completed latency_us = 278 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:58603 req_id = 52a69aac-405d-4477-853b-52a027a3561e response_code = 200 uri = /config
472026-08-26T21:29:48.334ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5855, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56159 req_id = 752f7d96-0a5b-417e-9393-72f3a02e40e4
482026-08-26T21:29:50.022ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 3380, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:1788 req_id = 6694885d-e4d1-4817-b90e-fb797757df51
492026-08-26T21:29:50.101ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8344, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:62217 req_id = 86e250d1-8262-453a-b271-076f538eebac
502026-08-26T21:29:50.178ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:45277
512026-08-26T21:29:50.178ZINFOdns-server (http): request completed latency_us = 200 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:45277 req_id = 82148fc2-ab91-412d-be40-7ebebf1289bb response_code = 200 uri = /config
522026-08-26T21:29:50.266ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:46704
532026-08-26T21:29:50.266ZINFOdns-server (http): request completed latency_us = 198 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:46704 req_id = 9a7953bc-0e2c-47a1-8529-03da97eddad7 response_code = 200 uri = /config
542026-08-26T21:29:58.336ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26055, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:51731 req_id = 6401b728-d350-4e6d-ade8-fe982a16a22d
552026-08-26T21:30:00.026ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11180, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d."), ), original: Query { name: Name("oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 53, 57, 49, 52, 48, 101, 102, 45, 99, 99, 51, 48, 45, 52, 98, 97, 49, 45, 56, 56, 55, 102, 45, 102, 57, 56, 49, 100, 50, 51, 100, 56, 53, 55, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d." peer_addr = [fd00:1122:3344:101::6]:44013 req_id = a3715058-3a35-4cd5-922a-ba8e0b7450b4
562026-08-26T21:30:00.027ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11180, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d."), ), original: Query { name: Name("oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 53, 57, 49, 52, 48, 101, 102, 45, 99, 99, 51, 48, 45, 52, 98, 97, 49, 45, 56, 56, 55, 102, 45, 102, 57, 56, 49, 100, 50, 51, 100, 56, 53, 55, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d." peer_addr = [fd00:1122:3344:101::6]:55312 req_id = 0dddc749-fa5f-48a0-b12c-1c976b92e465
572026-08-26T21:30:00.030ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1507, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0."), ), original: Query { name: Name("oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 100, 100, 57, 99, 50, 100, 101, 45, 102, 97, 53, 56, 45, 52, 54, 56, 99, 45, 98, 56, 52, 56, 45, 97, 55, 98, 53, 50, 101, 102, 49, 56, 97, 100, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0." peer_addr = [fd00:1122:3344:101::7]:50566 req_id = 670b92cb-bc84-4b10-8b4f-ecafce301981
582026-08-26T21:30:00.030ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1507, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0."), ), original: Query { name: Name("oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 100, 100, 57, 99, 50, 100, 101, 45, 102, 97, 53, 56, 45, 52, 54, 56, 99, 45, 98, 56, 52, 56, 45, 97, 55, 98, 53, 50, 101, 102, 49, 56, 97, 100, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0." peer_addr = [fd00:1122:3344:101::7]:35877 req_id = df0a9edc-e8f7-4a45-9896-6ef9379273e1
592026-08-26T21:30:00.281ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5444, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:36610 req_id = 3f559245-56ab-48d9-bf18-32eda38045f7
602026-08-26T21:30:00.282ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5444, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:33490 req_id = b2ec252e-f9af-45ba-8e77-e91be63b74f7
612026-08-26T21:30:00.580ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), ), original: Query { name: Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 101, 102, 97, 55, 53, 99, 54, 45, 50, 98, 53, 97, 45, 52, 55, 51, 102, 45, 57, 56, 56, 102, 45, 51, 57, 49, 99, 50, 53, 49, 51, 97, 57, 49, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913." peer_addr = [fd00:1122:3344:101::e]:33898 req_id = 27bb81b7-a3b4-4e76-b883-129fe9ad8d3e
622026-08-26T21:30:00.581ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), ), original: Query { name: Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 101, 102, 97, 55, 53, 99, 54, 45, 50, 98, 53, 97, 45, 52, 55, 51, 102, 45, 57, 56, 56, 102, 45, 51, 57, 49, 99, 50, 53, 49, 51, 97, 57, 49, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913." peer_addr = [fd00:1122:3344:101::e]:44340 req_id = 77445cb2-7649-4fe8-9c95-64c00bb711e4
632026-08-26T21:30:00.784ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37029, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_e50e1acc-9160-448f-82fc-866ef90859fe."), ), original: Query { name: Name("oxz_ntp_e50e1acc-9160-448f-82fc-866ef90859fe."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 101, 53, 48, 101, 49, 97, 99, 99, 45, 57, 49, 54, 48, 45, 52, 52, 56, 102, 45, 56, 50, 102, 99, 45, 56, 54, 54, 101, 102, 57, 48, 56, 53, 57, 102, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_e50e1acc-9160-448f-82fc-866ef90859fe." peer_addr = [fd00:1122:3344:101::1b]:33826 req_id = 212b6085-aa83-4f25-a090-b5df4d4c6ddf
642026-08-26T21:30:00.871ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17889, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61."), ), original: Query { name: Name("oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 52, 57, 57, 51, 57, 52, 50, 45, 52, 102, 98, 49, 45, 52, 55, 54, 99, 45, 97, 48, 102, 100, 45, 55, 48, 101, 55, 49, 97, 52, 49, 52, 99, 54, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61." peer_addr = [fd00:1122:3344:101::4]:34939 req_id = b829e347-d059-429d-9bab-f7a4b57ffa85
652026-08-26T21:30:00.871ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17889, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61."), ), original: Query { name: Name("oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 52, 57, 57, 51, 57, 52, 50, 45, 52, 102, 98, 49, 45, 52, 55, 54, 99, 45, 97, 48, 102, 100, 45, 55, 48, 101, 55, 49, 97, 52, 49, 52, 99, 54, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61." peer_addr = [fd00:1122:3344:101::4]:62680 req_id = 65c42d27-a74c-45f5-b388-7eba0ad019d6
662026-08-26T21:30:00.950ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11860, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1."), ), original: Query { name: Name("oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 56, 100, 98, 101, 49, 98, 53, 45, 56, 49, 102, 48, 45, 52, 99, 55, 52, 45, 97, 51, 56, 100, 45, 56, 99, 97, 53, 55, 101, 49, 97, 56, 49, 102, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1." peer_addr = [fd00:1122:3344:101::5]:47487 req_id = 6f450552-853e-4c6c-838b-3eb2cf7a8ef5
672026-08-26T21:30:00.950ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11860, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1."), ), original: Query { name: Name("oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 56, 100, 98, 101, 49, 98, 53, 45, 56, 49, 102, 48, 45, 52, 99, 55, 52, 45, 97, 51, 56, 100, 45, 56, 99, 97, 53, 55, 101, 49, 97, 56, 49, 102, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1." peer_addr = [fd00:1122:3344:101::5]:37833 req_id = 16b1a9a8-d55f-44ef-a1b8-f68ce25bf2a4
682026-08-26T21:30:00.990ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20365, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c."), ), original: Query { name: Name("oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 50, 53, 97, 52, 48, 100, 99, 45, 49, 52, 57, 48, 45, 52, 49, 55, 56, 45, 97, 98, 102, 101, 45, 102, 49, 49, 50, 49, 50, 52, 52, 97, 56, 48, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c." peer_addr = [fd00:1122:3344:101::3]:58575 req_id = b4832b24-c8cf-4dfd-962c-7eddcf6bdb07
692026-08-26T21:30:00.991ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20365, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c."), ), original: Query { name: Name("oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 50, 53, 97, 52, 48, 100, 99, 45, 49, 52, 57, 48, 45, 52, 49, 55, 56, 45, 97, 98, 102, 101, 45, 102, 49, 49, 50, 49, 50, 52, 52, 97, 56, 48, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c." peer_addr = [fd00:1122:3344:101::3]:36103 req_id = 8009f94a-e2a6-41c4-abd4-5719731e8bc1