Max level shown:
1 [ May 18 23:57:31 Enabled. ]
2 [ May 18 23:57:31 Rereading configuration. ]
3 [ May 18 23:57:31 Rereading configuration. ]
4 [ May 18 23:57:32 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:1::1]:5353 --dns-address [fd00:1122:3344:1::1]:53 &"). ]
5 [ May 18 23:57:32 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-05-18T23:57:32.891ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:1::1]:53 }
92026-05-18T23:57:32.891ZINFOdns-server (store): opening sled database path = /data/dns
102026-05-18T23:57:32.913ZINFOdns-server (store): pruning trees for generations newer than 0
112026-05-18T23:57:32.913ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-05-18T23:57:32.913ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:1::1]:53
132026-05-18T23:57:32.913ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:1::1]:5353
142026-05-18T23:57:32.967ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:1::2]:53070
152026-05-18T23:57:32.968ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 48b3f061-4de4-4f65-9848-45b5f222acac
162026-05-18T23:57:32.968ZINFOdns-server (store): pruning trees for generations newer than 0
172026-05-18T23:57:32.980ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-05-18T23:57:32.980ZINFOdns-server (store): updated generation new_generation = 1 req_id = 48b3f061-4de4-4f65-9848-45b5f222acac
192026-05-18T23:57:32.980ZINFOdns-server (http): request completed latency_us = 12947 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:1::2]:53070 req_id = 48b3f061-4de4-4f65-9848-45b5f222acac response_code = 204 uri = /config
202026-05-18T23:57:45.427ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18992, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:50679 req_id = b001ff93-996c-45f1-b8db-be40bd848477
212026-05-18T23:57:45.432ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:58778 req_id = 8d86ff77-31e2-44dc-9ed5-1975778bdf23
222026-05-18T23:57:45.436ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23076, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:48736 req_id = cdd641dc-2e41-415d-bb51-cf5e50ae3ced
232026-05-18T23:58:58.094ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17980, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:50448 req_id = a9aff72f-8bca-485d-9571-53b9e043ca18
242026-05-18T23:59:03.914ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9337, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), ), original: Query { name: Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 48, 52, 54, 99, 99, 53, 97, 97, 45, 57, 53, 97, 97, 45, 52, 99, 98, 48, 45, 97, 54, 52, 56, 45, 99, 98, 54, 52, 54, 101, 50, 101, 101, 49, 50, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a." peer_addr = [fd00:1122:3344:101::e]:40045 req_id = 0340be25-bb83-45be-928f-af270737ea11
252026-05-18T23:59:03.930ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9337, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), ), original: Query { name: Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 48, 52, 54, 99, 99, 53, 97, 97, 45, 57, 53, 97, 97, 45, 52, 99, 98, 48, 45, 97, 54, 52, 56, 45, 99, 98, 54, 52, 54, 101, 50, 101, 101, 49, 50, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a." peer_addr = [fd00:1122:3344:101::e]:36597 req_id = 07b37f70-c9ae-4fdb-8c32-3702c405b935
262026-05-18T23:59:08.065ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9788, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:51556 req_id = 8272c1df-16fd-474d-b02b-e529f1e3a48d
272026-05-18T23:59:12.028ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48371, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:19413 req_id = 117333a6-bfe7-4bee-b30f-10466cb5eb7c
282026-05-18T23:59:12.043ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10356, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:62710 req_id = 4277ee98-5d8b-4a92-8e9e-da2c87bfcf6b
292026-05-18T23:59:12.046ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59826, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:62095 req_id = ef99b9cc-c9db-4a85-ac6c-8faf9ad5f5c3
302026-05-18T23:59:18.074ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34233, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:58781 req_id = b1f7b398-fc4a-4581-9fa3-b64abe7aa0a8
312026-05-18T23:59:28.076ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31527, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53641 req_id = aa156c2f-22a4-462a-8377-cfff70676188
322026-05-18T23:59:38.078ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24643, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57868 req_id = 5cf00e00-3b09-45bb-8259-95158f3c301a
332026-05-18T23:59:46.506ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40584, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35547 req_id = 5b7921f4-ff13-43b2-8ff7-7252e949caea
342026-05-18T23:59:46.510ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7817, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:44203 req_id = 3ea9d2f0-49de-4e0f-9718-191948e389d8
352026-05-18T23:59:46.514ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2107, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:38016 req_id = 1eff922d-0822-48d3-9715-e7f7beeb6b2a
362026-05-18T23:59:48.080ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18773, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:60239 req_id = 3dba6c40-ff7b-49b6-b864-45b53d60e260
372026-05-18T23:59:53.854ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25700, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:4045 req_id = 1b52ed53-795a-490a-90d5-53e5a6f9eff8
382026-05-18T23:59:54.267ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:45937
392026-05-18T23:59:54.345ZINFOdns-server (http): request completed latency_us = 48943 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:45937 req_id = 8fb3386b-df0c-45b5-94d0-618084977325 response_code = 200 uri = /config
402026-05-18T23:59:55.266ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 916, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:51032 req_id = e92f8dd6-8bd0-4474-b4c9-aba66cf49de5
412026-05-18T23:59:55.295ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:56953
422026-05-18T23:59:55.297ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5f24db1c-fbd0-4bf2-9a50-1454f2acf17c
432026-05-18T23:59:55.297ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5f24db1c-fbd0-4bf2-9a50-1454f2acf17c
442026-05-18T23:59:55.297ZINFOdns-server (http): request completed latency_us = 396 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:56953 req_id = 5f24db1c-fbd0-4bf2-9a50-1454f2acf17c response_code = 204 uri = /config
452026-05-18T23:59:55.464ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:34401
462026-05-18T23:59:55.464ZINFOdns-server (http): request completed latency_us = 255 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:34401 req_id = 7050da56-af0f-4a9c-a767-424dea836c2e response_code = 200 uri = /config
472026-05-18T23:59:56.112ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17369, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:40224 req_id = ceb44101-aa4f-4d26-a53a-65fbf826cffc
482026-05-18T23:59:56.217ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:55859
492026-05-18T23:59:56.218ZINFOdns-server (http): request completed latency_us = 260 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:55859 req_id = 5f876c6d-71ed-4a94-9dbd-04095fd554f6 response_code = 200 uri = /config
502026-05-18T23:59:58.082ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44308, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:64848 req_id = bd09a34f-70fd-49de-ac95-82fd124023b1
512026-05-19T00:00:00.116ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33884, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), ), original: Query { name: Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 48, 52, 54, 99, 99, 53, 97, 97, 45, 57, 53, 97, 97, 45, 52, 99, 98, 48, 45, 97, 54, 52, 56, 45, 99, 98, 54, 52, 54, 101, 50, 101, 101, 49, 50, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a." peer_addr = [fd00:1122:3344:101::e]:59713 req_id = 274badb0-b825-41a3-a5c9-3e7a58a61e1f
522026-05-19T00:00:00.117ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33884, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), ), original: Query { name: Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 48, 52, 54, 99, 99, 53, 97, 97, 45, 57, 53, 97, 97, 45, 52, 99, 98, 48, 45, 97, 54, 52, 56, 45, 99, 98, 54, 52, 54, 101, 50, 101, 101, 49, 50, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a." peer_addr = [fd00:1122:3344:101::e]:48427 req_id = 7e1774a6-1917-4ebe-9686-f1815156be7b
532026-05-19T00:00:00.130ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4530, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc."), ), original: Query { name: Name("oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 97, 97, 49, 55, 55, 101, 102, 45, 98, 50, 97, 100, 45, 52, 56, 55, 51, 45, 97, 100, 54, 100, 45, 49, 49, 52, 97, 55, 56, 48, 54, 54, 100, 100, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc." peer_addr = [fd00:1122:3344:101::4]:38185 req_id = d5c56b26-f2f5-420d-95e7-9c55cd752477
542026-05-19T00:00:00.131ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4530, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc."), ), original: Query { name: Name("oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 97, 97, 49, 55, 55, 101, 102, 45, 98, 50, 97, 100, 45, 52, 56, 55, 51, 45, 97, 100, 54, 100, 45, 49, 49, 52, 97, 55, 56, 48, 54, 54, 100, 100, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc." peer_addr = [fd00:1122:3344:101::4]:63661 req_id = 0c24c6ca-8d06-477a-998a-b1c90c481921
552026-05-19T00:00:00.174ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2745, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60."), ), original: Query { name: Name("oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 53, 55, 53, 56, 100, 57, 49, 45, 50, 56, 102, 56, 45, 52, 49, 98, 48, 45, 97, 56, 54, 101, 45, 57, 54, 100, 102, 54, 101, 55, 52, 99, 99, 54, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60." peer_addr = [fd00:1122:3344:101::3]:40843 req_id = 598500b6-d269-43f6-aae4-762be2748d32
562026-05-19T00:00:00.175ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2745, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60."), ), original: Query { name: Name("oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 53, 55, 53, 56, 100, 57, 49, 45, 50, 56, 102, 56, 45, 52, 49, 98, 48, 45, 97, 56, 54, 101, 45, 57, 54, 100, 102, 54, 101, 55, 52, 99, 99, 54, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60." peer_addr = [fd00:1122:3344:101::3]:40177 req_id = 5b475c70-43b1-41a7-aa16-d6b5904a4223
572026-05-19T00:00:00.184ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64100, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c."), ), original: Query { name: Name("oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 101, 50, 101, 48, 50, 101, 99, 45, 48, 51, 99, 52, 45, 52, 98, 100, 99, 45, 56, 49, 99, 57, 45, 98, 49, 99, 55, 53, 97, 101, 56, 102, 50, 51, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c." peer_addr = [fd00:1122:3344:101::5]:48440 req_id = c6ebf424-8258-4995-a22d-8b0152adb69c
582026-05-19T00:00:00.184ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64100, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c."), ), original: Query { name: Name("oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 101, 50, 101, 48, 50, 101, 99, 45, 48, 51, 99, 52, 45, 52, 98, 100, 99, 45, 56, 49, 99, 57, 45, 98, 49, 99, 55, 53, 97, 101, 56, 102, 50, 51, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c." peer_addr = [fd00:1122:3344:101::5]:40467 req_id = 62e08cf6-b4d2-463c-ba33-d85e7ee071cf
592026-05-19T00:00:00.904ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14606, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0."), ), original: Query { name: Name("oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 49, 52, 56, 52, 57, 50, 49, 45, 49, 49, 48, 54, 45, 52, 57, 100, 102, 45, 98, 50, 102, 51, 45, 51, 55, 101, 50, 56, 98, 102, 101, 48, 102, 102, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0." peer_addr = [fd00:1122:3344:101::6]:37857 req_id = 17601586-2b2a-4b26-baa1-7cfab08414e5
602026-05-19T00:00:00.905ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14606, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0."), ), original: Query { name: Name("oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 49, 52, 56, 52, 57, 50, 49, 45, 49, 49, 48, 54, 45, 52, 57, 100, 102, 45, 98, 50, 102, 51, 45, 51, 55, 101, 50, 56, 98, 102, 101, 48, 102, 102, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0." peer_addr = [fd00:1122:3344:101::6]:36920 req_id = ef28e11c-c6ce-45ee-88f2-1cd96c315725
612026-05-19T00:00:00.954ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39124, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57."), ), original: Query { name: Name("oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 102, 56, 102, 51, 50, 102, 54, 45, 53, 56, 50, 55, 45, 52, 100, 97, 50, 45, 97, 51, 102, 54, 45, 98, 52, 102, 101, 48, 53, 55, 52, 52, 98, 53, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57." peer_addr = [fd00:1122:3344:101::7]:38633 req_id = 03ea29c9-ecc1-4a1f-818f-b60687b15c09
622026-05-19T00:00:00.955ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39124, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57."), ), original: Query { name: Name("oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 102, 56, 102, 51, 50, 102, 54, 45, 53, 56, 50, 55, 45, 52, 100, 97, 50, 45, 97, 51, 102, 54, 45, 98, 52, 102, 101, 48, 53, 55, 52, 52, 98, 53, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57." peer_addr = [fd00:1122:3344:101::7]:63039 req_id = 6b11f2ad-38e4-4a86-8d8d-71e830c66211
632026-05-19T00:00:01.054ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45682, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_0285cb68-7ec8-485c-8343-aa642962ddd1."), ), original: Query { name: Name("oxz_ntp_0285cb68-7ec8-485c-8343-aa642962ddd1."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 48, 50, 56, 53, 99, 98, 54, 56, 45, 55, 101, 99, 56, 45, 52, 56, 53, 99, 45, 56, 51, 52, 51, 45, 97, 97, 54, 52, 50, 57, 54, 50, 100, 100, 100, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_0285cb68-7ec8-485c-8343-aa642962ddd1." peer_addr = [fd00:1122:3344:101::1b]:34160 req_id = de2b96f0-b063-4276-b268-faf68d86692c
642026-05-19T00:00:01.546ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18215, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:61898 req_id = 61ec2cb9-ed28-4585-a6dd-7f76d26c6b40
652026-05-19T00:00:01.546ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18215, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:50331 req_id = a8a7e1c2-d74e-4a7f-9a56-b0fd9d7b1256