Max level shown:
1 [ Aug 26 21:26:19 Enabled. ]
2 [ Aug 26 21:26:19 Rereading configuration. ]
3 [ Aug 26 21:26:19 Rereading configuration. ]
4 [ Aug 26 21:26:21 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ Aug 26 21:26:21 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-08-26T21:26:21.112ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-08-26T21:26:21.112ZINFOdns-server (store): opening sled database path = /data/dns
102026-08-26T21:26:21.132ZINFOdns-server (store): pruning trees for generations newer than 0
112026-08-26T21:26:21.132ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-08-26T21:26:21.132ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-08-26T21:26:21.132ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-08-26T21:26:21.224ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6367, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:33346 req_id = 04b01b54-63bc-48c3-9f59-c19adaa888b2
152026-08-26T21:26:21.259ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:53102
162026-08-26T21:26:21.260ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a35a2dfe-a68b-4374-9f8e-f46bc7e7c0fd
172026-08-26T21:26:21.260ZINFOdns-server (store): pruning trees for generations newer than 0
182026-08-26T21:26:21.288ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
192026-08-26T21:26:21.288ZINFOdns-server (store): updated generation new_generation = 1 req_id = a35a2dfe-a68b-4374-9f8e-f46bc7e7c0fd
202026-08-26T21:26:21.288ZINFOdns-server (http): request completed latency_us = 28476 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:53102 req_id = a35a2dfe-a68b-4374-9f8e-f46bc7e7c0fd response_code = 204 uri = /config
212026-08-26T21:26:34.394ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21382, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:39935 req_id = a9578a2d-3657-4ad8-af5a-a36fd2bcddde
222026-08-26T21:26:34.399ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19885, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:39714 req_id = 00d11849-853d-40ac-bbfc-5ef5aa38d2a5
232026-08-26T21:26:34.404ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35666, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:63934 req_id = 0222e94a-b557-41c2-8042-31e3a00897b7
242026-08-26T21:28:58.341ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33671, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55449 req_id = 47fdfbae-062d-41e0-b078-4a0621f14722
252026-08-26T21:29:08.327ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12790, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:52768 req_id = 081e43ff-5144-42b5-b984-63ad0fbe0b73
262026-08-26T21:29:08.426ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10145, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), ), original: Query { name: Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 101, 102, 97, 55, 53, 99, 54, 45, 50, 98, 53, 97, 45, 52, 55, 51, 102, 45, 57, 56, 56, 102, 45, 51, 57, 49, 99, 50, 53, 49, 51, 97, 57, 49, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913." peer_addr = [fd00:1122:3344:101::e]:61199 req_id = aa6857c6-5e1c-43db-9af3-fd47f90f45f0
272026-08-26T21:29:08.440ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10145, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), ), original: Query { name: Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 101, 102, 97, 55, 53, 99, 54, 45, 50, 98, 53, 97, 45, 52, 55, 51, 102, 45, 57, 56, 56, 102, 45, 51, 57, 49, 99, 50, 53, 49, 51, 97, 57, 49, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913." peer_addr = [fd00:1122:3344:101::e]:40108 req_id = de316bfa-ebb9-477a-a2f7-a418b949a1d4
282026-08-26T21:29:09.150ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12975, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:44523 req_id = d077cffc-1707-40ac-9421-821d5ae6fe01
292026-08-26T21:29:09.353ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31128, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:50799 req_id = 46c2f688-22b0-4800-a242-c48e7ffe702c
302026-08-26T21:29:09.604ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60498, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:49133 req_id = 53811574-d1a0-4c9a-93db-fe8bdda3d764
312026-08-26T21:29:18.329ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28400, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61670 req_id = 6268fe1c-8f43-426b-bc38-f1dacc7c0a41
322026-08-26T21:29:28.331ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51514, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:49354 req_id = 46da1a11-4290-49f3-92aa-114a73e230eb
332026-08-26T21:29:38.333ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55494, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:64307 req_id = a65b1f92-ad6b-458e-b7c6-2e360d7a8623
342026-08-26T21:29:39.443ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25542, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:23359 req_id = 8951d73a-c540-4518-8b03-6f6fbe7766af
352026-08-26T21:29:39.771ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:36613
362026-08-26T21:29:39.824ZINFOdns-server (http): request completed latency_us = 23661 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:36613 req_id = 4e205713-9730-420e-b2de-bcdb87a12d05 response_code = 200 uri = /config
372026-08-26T21:29:42.120ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:49431
382026-08-26T21:29:42.121ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e7facc96-168a-4080-a218-0b9278f63382
392026-08-26T21:29:42.122ZINFOdns-server (store): updated generation new_generation = 1 req_id = e7facc96-168a-4080-a218-0b9278f63382
402026-08-26T21:29:42.122ZINFOdns-server (http): request completed latency_us = 259 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:49431 req_id = e7facc96-168a-4080-a218-0b9278f63382 response_code = 204 uri = /config
412026-08-26T21:29:42.418ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23407, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:31068 req_id = 73b5ba08-0278-4796-94d9-d9214dce0df4
422026-08-26T21:29:42.730ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:56087
432026-08-26T21:29:42.730ZINFOdns-server (http): request completed latency_us = 221 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:56087 req_id = 07ce4b38-0cb6-4cd5-9c62-49ea100fe3f6 response_code = 200 uri = /config
442026-08-26T21:29:43.918ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22412, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:22381 req_id = a0db97e0-1015-45e6-aea3-263262649b26
452026-08-26T21:29:44.067ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:34400
462026-08-26T21:29:44.067ZINFOdns-server (http): request completed latency_us = 191 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:34400 req_id = 6af50b66-8eaa-4d75-99c8-36bae43ed5a3 response_code = 200 uri = /config
472026-08-26T21:29:48.334ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61376, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:58019 req_id = ed54f419-4f30-4994-8398-eec73426d3fd
482026-08-26T21:29:50.022ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28728, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:57716 req_id = 0da76e39-1dff-4da9-a9bf-638282f7d23e
492026-08-26T21:29:50.101ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4015, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:54589 req_id = 7fe18313-842f-42b5-a54c-04dc6a9811ad
502026-08-26T21:29:50.177ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:56605
512026-08-26T21:29:50.177ZINFOdns-server (http): request completed latency_us = 393 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:56605 req_id = d2e757e7-0dc2-44c3-bc2e-44b2dad1940c response_code = 200 uri = /config
522026-08-26T21:29:50.265ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:37627
532026-08-26T21:29:50.265ZINFOdns-server (http): request completed latency_us = 170 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:37627 req_id = 5aabf7d7-8652-4efc-9624-71831e3c2820 response_code = 200 uri = /config
542026-08-26T21:29:58.335ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27335, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63406 req_id = a830de2f-f223-43a8-a6e5-2d3ef3ad7567
552026-08-26T21:30:00.026ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11180, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d."), ), original: Query { name: Name("oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 53, 57, 49, 52, 48, 101, 102, 45, 99, 99, 51, 48, 45, 52, 98, 97, 49, 45, 56, 56, 55, 102, 45, 102, 57, 56, 49, 100, 50, 51, 100, 56, 53, 55, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d." peer_addr = [fd00:1122:3344:101::6]:53268 req_id = 9b973110-d7f5-4e06-af95-08e45d8060e2
562026-08-26T21:30:00.027ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11180, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d."), ), original: Query { name: Name("oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 53, 57, 49, 52, 48, 101, 102, 45, 99, 99, 51, 48, 45, 52, 98, 97, 49, 45, 56, 56, 55, 102, 45, 102, 57, 56, 49, 100, 50, 51, 100, 56, 53, 55, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e59140ef-cc30-4ba1-887f-f981d23d857d." peer_addr = [fd00:1122:3344:101::6]:56275 req_id = d97382e5-c24e-421d-9e01-01d25b779074
572026-08-26T21:30:00.030ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1507, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0."), ), original: Query { name: Name("oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 100, 100, 57, 99, 50, 100, 101, 45, 102, 97, 53, 56, 45, 52, 54, 56, 99, 45, 98, 56, 52, 56, 45, 97, 55, 98, 53, 50, 101, 102, 49, 56, 97, 100, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0." peer_addr = [fd00:1122:3344:101::7]:57734 req_id = 482367bd-5d16-419f-8f77-45ab2573d1d4
582026-08-26T21:30:00.030ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1507, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0."), ), original: Query { name: Name("oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 100, 100, 57, 99, 50, 100, 101, 45, 102, 97, 53, 56, 45, 52, 54, 56, 99, 45, 98, 56, 52, 56, 45, 97, 55, 98, 53, 50, 101, 102, 49, 56, 97, 100, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5dd9c2de-fa58-468c-b848-a7b52ef18ad0." peer_addr = [fd00:1122:3344:101::7]:47514 req_id = c8edc36d-06a1-48e6-bb4e-d29151fb457c
592026-08-26T21:30:00.281ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5444, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:54959 req_id = 550c3b35-5f81-48f5-a4b3-57dc271b37e8
602026-08-26T21:30:00.282ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5444, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:45947 req_id = b6c2b093-799b-46cc-8d88-2016b0ab29e2
612026-08-26T21:30:00.580ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), ), original: Query { name: Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 101, 102, 97, 55, 53, 99, 54, 45, 50, 98, 53, 97, 45, 52, 55, 51, 102, 45, 57, 56, 56, 102, 45, 51, 57, 49, 99, 50, 53, 49, 51, 97, 57, 49, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913." peer_addr = [fd00:1122:3344:101::e]:34365 req_id = 0a68f047-161f-4cd9-8b34-844c41d6ee60
622026-08-26T21:30:00.581ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), ), original: Query { name: Name("oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 52, 101, 102, 97, 55, 53, 99, 54, 45, 50, 98, 53, 97, 45, 52, 55, 51, 102, 45, 57, 56, 56, 102, 45, 51, 57, 49, 99, 50, 53, 49, 51, 97, 57, 49, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_4efa75c6-2b5a-473f-988f-391c2513a913." peer_addr = [fd00:1122:3344:101::e]:35864 req_id = ea2f41ba-d79a-4bbd-ab0f-72dc3e4cf882
632026-08-26T21:30:00.784ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37029, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_e50e1acc-9160-448f-82fc-866ef90859fe."), ), original: Query { name: Name("oxz_ntp_e50e1acc-9160-448f-82fc-866ef90859fe."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 101, 53, 48, 101, 49, 97, 99, 99, 45, 57, 49, 54, 48, 45, 52, 52, 56, 102, 45, 56, 50, 102, 99, 45, 56, 54, 54, 101, 102, 57, 48, 56, 53, 57, 102, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_e50e1acc-9160-448f-82fc-866ef90859fe." peer_addr = [fd00:1122:3344:101::1b]:35365 req_id = 91b82de7-7f97-4ee8-9476-865ac9e98ab9
642026-08-26T21:30:00.871ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17889, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61."), ), original: Query { name: Name("oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 52, 57, 57, 51, 57, 52, 50, 45, 52, 102, 98, 49, 45, 52, 55, 54, 99, 45, 97, 48, 102, 100, 45, 55, 48, 101, 55, 49, 97, 52, 49, 52, 99, 54, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61." peer_addr = [fd00:1122:3344:101::4]:54380 req_id = 2b49ca54-3e43-4462-bbdb-8c72730258e4
652026-08-26T21:30:00.872ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17889, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61."), ), original: Query { name: Name("oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 52, 57, 57, 51, 57, 52, 50, 45, 52, 102, 98, 49, 45, 52, 55, 54, 99, 45, 97, 48, 102, 100, 45, 55, 48, 101, 55, 49, 97, 52, 49, 52, 99, 54, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_44993942-4fb1-476c-a0fd-70e71a414c61." peer_addr = [fd00:1122:3344:101::4]:42514 req_id = ec1ecf80-8a4e-46bd-8eb2-05dd739665a1
662026-08-26T21:30:00.950ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11860, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1."), ), original: Query { name: Name("oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 56, 100, 98, 101, 49, 98, 53, 45, 56, 49, 102, 48, 45, 52, 99, 55, 52, 45, 97, 51, 56, 100, 45, 56, 99, 97, 53, 55, 101, 49, 97, 56, 49, 102, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1." peer_addr = [fd00:1122:3344:101::5]:57517 req_id = 5f70869f-5d80-4e30-b25d-428d98c068b8
672026-08-26T21:30:00.951ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11860, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1."), ), original: Query { name: Name("oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 56, 100, 98, 101, 49, 98, 53, 45, 56, 49, 102, 48, 45, 52, 99, 55, 52, 45, 97, 51, 56, 100, 45, 56, 99, 97, 53, 55, 101, 49, 97, 56, 49, 102, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_78dbe1b5-81f0-4c74-a38d-8ca57e1a81f1." peer_addr = [fd00:1122:3344:101::5]:63372 req_id = 863a4d6c-2814-404e-88aa-4b582668603f
682026-08-26T21:30:00.990ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20365, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c."), ), original: Query { name: Name("oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 50, 53, 97, 52, 48, 100, 99, 45, 49, 52, 57, 48, 45, 52, 49, 55, 56, 45, 97, 98, 102, 101, 45, 102, 49, 49, 50, 49, 50, 52, 52, 97, 56, 48, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c." peer_addr = [fd00:1122:3344:101::3]:47937 req_id = 92f31c55-5da3-446e-8060-0fdaac4fd5e0
692026-08-26T21:30:00.991ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20365, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c."), ), original: Query { name: Name("oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 50, 53, 97, 52, 48, 100, 99, 45, 49, 52, 57, 48, 45, 52, 49, 55, 56, 45, 97, 98, 102, 101, 45, 102, 49, 49, 50, 49, 50, 52, 52, 97, 56, 48, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_225a40dc-1490-4178-abfe-f1121244a80c." peer_addr = [fd00:1122:3344:101::3]:62695 req_id = 49b0a74d-1243-406d-8f36-658deec88457