Max level shown:
1 [ Mar 24 18:27:29 Enabled. ]
2 [ Mar 24 18:27:29 Rereading configuration. ]
3 [ Mar 24 18:27:30 Rereading configuration. ]
4 [ Mar 24 18:27:31 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Mar 24 18:27:31 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-03-24T18:27:31.617ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-03-24T18:27:31.617ZINFOdns-server (store): opening sled database path = /data/dns
102026-03-24T18:27:31.637ZINFOdns-server (store): pruning trees for generations newer than 0
112026-03-24T18:27:31.637ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-03-24T18:27:31.637ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-03-24T18:27:31.637ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-03-24T18:27:31.714ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37749, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:19187 req_id = 909aba83-cef3-4abc-8738-9579a6d18b75
152026-03-24T18:27:31.746ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58783, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:12794 req_id = 0973bfb8-dfeb-4fdd-8577-ed41b10f96bc
162026-03-24T18:27:31.808ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21125, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:37098 req_id = bcabb418-efd2-4453-b28b-5c1353a4b701
172026-03-24T18:27:31.914ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2483, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:48238 req_id = 7af45dbd-f69c-48c7-bd0e-b9bba170785e
182026-03-24T18:27:31.935ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32755, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:5828 req_id = e30f7c87-0dee-4fc9-896b-7684009ca7ce
192026-03-24T18:27:31.997ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7349, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:7205 req_id = ff14d83c-8770-4814-a17a-24622fa14fdf
202026-03-24T18:27:32.009ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 3548, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:54290 req_id = 0baa5927-1de1-4494-91b4-e7b94674fdcc
212026-03-24T18:27:32.054ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1772, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:48880 req_id = 38a18912-0613-4686-9c83-18e7e3d8346a
222026-03-24T18:27:32.146ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57502, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:18139 req_id = d2bb243f-1648-410a-b6ac-ec901de49460
232026-03-24T18:27:32.151ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26892, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:53878 req_id = d1db717f-b53f-47d3-b1fa-338522cf75ae
242026-03-24T18:27:32.218ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48128, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:62079 req_id = da6feefc-52e2-4d32-b260-4f417ce271b5
252026-03-24T18:27:32.336ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42330, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:54428 req_id = 475a5656-b6a1-4d9b-b311-d40a70abf6b9
262026-03-24T18:27:32.394ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57657, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:27464 req_id = b7a3cdf5-0cb9-4fe8-9d67-e40330668cc4
272026-03-24T18:27:32.434ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:43125
282026-03-24T18:27:32.435ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 31c34fb3-e2d9-4f10-b563-b26ed6e1fcd2
292026-03-24T18:27:32.435ZINFOdns-server (store): pruning trees for generations newer than 0
302026-03-24T18:27:32.452ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
312026-03-24T18:27:32.452ZINFOdns-server (store): updated generation new_generation = 1 req_id = 31c34fb3-e2d9-4f10-b563-b26ed6e1fcd2
322026-03-24T18:27:32.452ZINFOdns-server (http): request completed latency_us = 18041 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:43125 req_id = 31c34fb3-e2d9-4f10-b563-b26ed6e1fcd2 response_code = 204 uri = /config
332026-03-24T18:27:43.379ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38421, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:40924 req_id = 739e0cec-7c17-4eba-84e6-0ab06544bd5a
342026-03-24T18:27:43.384ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39440, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59851 req_id = 29c7d795-8f78-4e4e-b744-a9ab8d197325
352026-03-24T18:27:43.388ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20531, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:44782 req_id = fc20be3c-fbe5-4acf-9d24-534f6a421826
362026-03-24T18:29:17.486ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:47878 req_id = 9548e297-60f4-4637-84f7-950b45cfdf62
372026-03-24T18:29:17.496ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13389, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:42094 req_id = e0f539e2-76b1-4a0b-aa01-a093bb710af4
382026-03-24T18:29:17.502ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5876, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:64056 req_id = db023b8a-6cf0-4f18-9ec1-002ce55e4fba
392026-03-24T18:29:42.306ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62962, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:63587 req_id = 7de3e504-c5a4-43c5-8b01-7c321091912f
402026-03-24T18:29:42.306ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50787, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:56974 req_id = 0ae5e138-5f45-4977-aa43-d0e8c0b2b199
412026-03-24T18:29:42.306ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64646, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:60854 req_id = db980835-ff20-4b81-a292-9d384fd9978b
422026-03-24T18:29:46.222ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35678, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53392 req_id = 19639041-e8bf-48e2-b385-96b99e62805f
432026-03-24T18:29:52.749ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38016, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777."), ), original: Query { name: Name("oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 102, 53, 100, 53, 49, 100, 50, 55, 45, 100, 99, 48, 98, 45, 52, 49, 57, 55, 45, 97, 54, 98, 50, 45, 48, 100, 54, 50, 99, 51, 57, 99, 99, 55, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777." peer_addr = [fd00:1122:3344:101::e]:57591 req_id = 7bd2ab13-83d4-46a6-87ae-4b72a89e0b82
442026-03-24T18:29:52.749ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38016, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777."), ), original: Query { name: Name("oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 102, 53, 100, 53, 49, 100, 50, 55, 45, 100, 99, 48, 98, 45, 52, 49, 57, 55, 45, 97, 54, 98, 50, 45, 48, 100, 54, 50, 99, 51, 57, 99, 99, 55, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777." peer_addr = [fd00:1122:3344:101::e]:46564 req_id = 6527ea8b-18cf-4e0a-8741-f35ea271a390
452026-03-24T18:29:56.223ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1323, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63669 req_id = 4d18f195-408e-4553-8ba5-f45a8181292d
462026-03-24T18:29:59.916ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60343, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:2127 req_id = 14026482-8b06-43ec-a3b6-050c8cd468cc
472026-03-24T18:30:00.045ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64502, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:13626 req_id = aceb6273-53ce-48cb-a0a1-839b5913d1ea
482026-03-24T18:30:00.056ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28848, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:63115 req_id = be1a669e-8127-4e8c-bccf-998dde66136f
492026-03-24T18:30:00.072ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4267, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9021617e-29d4-4899-a501-fcbe2ef200aa."), ), original: Query { name: Name("oxz_cockroachdb_9021617e-29d4-4899-a501-fcbe2ef200aa."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 48, 50, 49, 54, 49, 55, 101, 45, 50, 57, 100, 52, 45, 52, 56, 57, 57, 45, 97, 53, 48, 49, 45, 102, 99, 98, 101, 50, 101, 102, 50, 48, 48, 97, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9021617e-29d4-4899-a501-fcbe2ef200aa." peer_addr = [fd00:1122:3344:101::3]:58899 req_id = 4a3be99a-f2b3-422e-ae24-3bd786dac24b
502026-03-24T18:30:00.073ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4267, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9021617e-29d4-4899-a501-fcbe2ef200aa."), ), original: Query { name: Name("oxz_cockroachdb_9021617e-29d4-4899-a501-fcbe2ef200aa."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 48, 50, 49, 54, 49, 55, 101, 45, 50, 57, 100, 52, 45, 52, 56, 57, 57, 45, 97, 53, 48, 49, 45, 102, 99, 98, 101, 50, 101, 102, 50, 48, 48, 97, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9021617e-29d4-4899-a501-fcbe2ef200aa." peer_addr = [fd00:1122:3344:101::3]:41162 req_id = 73ce71ad-c945-4668-ba0d-2b892dba7f77
512026-03-24T18:30:00.074ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6115, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_20dac5ce-5125-4bf6-8b1b-db51a73309cd."), ), original: Query { name: Name("oxz_cockroachdb_20dac5ce-5125-4bf6-8b1b-db51a73309cd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 48, 100, 97, 99, 53, 99, 101, 45, 53, 49, 50, 53, 45, 52, 98, 102, 54, 45, 56, 98, 49, 98, 45, 100, 98, 53, 49, 97, 55, 51, 51, 48, 57, 99, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_20dac5ce-5125-4bf6-8b1b-db51a73309cd." peer_addr = [fd00:1122:3344:101::6]:54596 req_id = 063813c4-bfda-4c52-81d2-ec1147bdf70e
522026-03-24T18:30:00.074ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6115, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_20dac5ce-5125-4bf6-8b1b-db51a73309cd."), ), original: Query { name: Name("oxz_cockroachdb_20dac5ce-5125-4bf6-8b1b-db51a73309cd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 48, 100, 97, 99, 53, 99, 101, 45, 53, 49, 50, 53, 45, 52, 98, 102, 54, 45, 56, 98, 49, 98, 45, 100, 98, 53, 49, 97, 55, 51, 51, 48, 57, 99, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_20dac5ce-5125-4bf6-8b1b-db51a73309cd." peer_addr = [fd00:1122:3344:101::6]:53817 req_id = dee71603-7616-43c6-926d-d20f4e228fe1
532026-03-24T18:30:00.113ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53607, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_0c78db80-ae39-499b-902a-fcf6fb9b5462."), ), original: Query { name: Name("oxz_cockroachdb_0c78db80-ae39-499b-902a-fcf6fb9b5462."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 99, 55, 56, 100, 98, 56, 48, 45, 97, 101, 51, 57, 45, 52, 57, 57, 98, 45, 57, 48, 50, 97, 45, 102, 99, 102, 54, 102, 98, 57, 98, 53, 52, 54, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0c78db80-ae39-499b-902a-fcf6fb9b5462." peer_addr = [fd00:1122:3344:101::5]:56834 req_id = 962c8285-fc00-4fa7-8e11-da43b811a311
542026-03-24T18:30:00.114ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53607, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_0c78db80-ae39-499b-902a-fcf6fb9b5462."), ), original: Query { name: Name("oxz_cockroachdb_0c78db80-ae39-499b-902a-fcf6fb9b5462."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 99, 55, 56, 100, 98, 56, 48, 45, 97, 101, 51, 57, 45, 52, 57, 57, 98, 45, 57, 48, 50, 97, 45, 102, 99, 102, 54, 102, 98, 57, 98, 53, 52, 54, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0c78db80-ae39-499b-902a-fcf6fb9b5462." peer_addr = [fd00:1122:3344:101::5]:59749 req_id = 836bdd9e-adf2-4bb6-b9cd-4e178fffc3ef
552026-03-24T18:30:00.232ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64941, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_effbaddf-2078-411d-93c4-e85d230ec802."), ), original: Query { name: Name("oxz_cockroachdb_effbaddf-2078-411d-93c4-e85d230ec802."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 102, 102, 98, 97, 100, 100, 102, 45, 50, 48, 55, 56, 45, 52, 49, 49, 100, 45, 57, 51, 99, 52, 45, 101, 56, 53, 100, 50, 51, 48, 101, 99, 56, 48, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_effbaddf-2078-411d-93c4-e85d230ec802." peer_addr = [fd00:1122:3344:101::4]:41971 req_id = c8fd2192-b118-4fd8-b919-abf92fcc3a66
562026-03-24T18:30:00.232ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64941, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_effbaddf-2078-411d-93c4-e85d230ec802."), ), original: Query { name: Name("oxz_cockroachdb_effbaddf-2078-411d-93c4-e85d230ec802."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 102, 102, 98, 97, 100, 100, 102, 45, 50, 48, 55, 56, 45, 52, 49, 49, 100, 45, 57, 51, 99, 52, 45, 101, 56, 53, 100, 50, 51, 48, 101, 99, 56, 48, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_effbaddf-2078-411d-93c4-e85d230ec802." peer_addr = [fd00:1122:3344:101::4]:52014 req_id = e0a747dd-68ac-46af-87d0-d8797e1ceef7
572026-03-24T18:30:00.262ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34346, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777."), ), original: Query { name: Name("oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 102, 53, 100, 53, 49, 100, 50, 55, 45, 100, 99, 48, 98, 45, 52, 49, 57, 55, 45, 97, 54, 98, 50, 45, 48, 100, 54, 50, 99, 51, 57, 99, 99, 55, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777." peer_addr = [fd00:1122:3344:101::e]:38280 req_id = b8f8dd92-3861-4645-8d19-72b785d6fd97
582026-03-24T18:30:00.262ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34346, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777."), ), original: Query { name: Name("oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 102, 53, 100, 53, 49, 100, 50, 55, 45, 100, 99, 48, 98, 45, 52, 49, 57, 55, 45, 97, 54, 98, 50, 45, 48, 100, 54, 50, 99, 51, 57, 99, 99, 55, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_f5d51d27-dc0b-4197-a6b2-0d62c39cc777." peer_addr = [fd00:1122:3344:101::e]:54436 req_id = 0c18f3a4-d0b0-4498-b1ec-893249138e20
592026-03-24T18:30:00.297ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41372, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_49ae747f-9b86-4ed5-a14b-e2b0a45eb053."), ), original: Query { name: Name("oxz_cockroachdb_49ae747f-9b86-4ed5-a14b-e2b0a45eb053."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 57, 97, 101, 55, 52, 55, 102, 45, 57, 98, 56, 54, 45, 52, 101, 100, 53, 45, 97, 49, 52, 98, 45, 101, 50, 98, 48, 97, 52, 53, 101, 98, 48, 53, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_49ae747f-9b86-4ed5-a14b-e2b0a45eb053." peer_addr = [fd00:1122:3344:101::7]:51378 req_id = 1e1825eb-8b75-4a2a-a5cf-ee6823624676
602026-03-24T18:30:00.298ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41372, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_49ae747f-9b86-4ed5-a14b-e2b0a45eb053."), ), original: Query { name: Name("oxz_cockroachdb_49ae747f-9b86-4ed5-a14b-e2b0a45eb053."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 57, 97, 101, 55, 52, 55, 102, 45, 57, 98, 56, 54, 45, 52, 101, 100, 53, 45, 97, 49, 52, 98, 45, 101, 50, 98, 48, 97, 52, 53, 101, 98, 48, 53, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_49ae747f-9b86-4ed5-a14b-e2b0a45eb053." peer_addr = [fd00:1122:3344:101::7]:56026 req_id = 4901d5c5-df21-48e8-83eb-1effbd7921c3
612026-03-24T18:30:00.511ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18089, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:40108 req_id = 6bc87703-6ba2-4119-a92a-fc769c1bd72a
622026-03-24T18:30:00.512ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18089, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:52314 req_id = 0a6ff0c5-45f6-4689-ae18-67c953269fcb
632026-03-24T18:30:01.005ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27604, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_d0e75611-44ae-4c76-87ca-3cfc3f463717."), ), original: Query { name: Name("oxz_ntp_d0e75611-44ae-4c76-87ca-3cfc3f463717."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 100, 48, 101, 55, 53, 54, 49, 49, 45, 52, 52, 97, 101, 45, 52, 99, 55, 54, 45, 56, 55, 99, 97, 45, 51, 99, 102, 99, 51, 102, 52, 54, 51, 55, 49, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_d0e75611-44ae-4c76-87ca-3cfc3f463717." peer_addr = [fd00:1122:3344:101::1b]:37617 req_id = cba60a1b-c35e-4c97-b99d-8c7a5c03634a
642026-03-24T18:30:02.102ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:35313
652026-03-24T18:30:02.112ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:45599
662026-03-24T18:30:02.112ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:49121
672026-03-24T18:30:02.166ZINFOdns-server (http): request completed latency_us = 32957 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:35313 req_id = 8e5f389c-8683-4fc9-b017-4566afb26109 response_code = 200 uri = /config
682026-03-24T18:30:02.167ZINFOdns-server (http): request completed latency_us = 32961 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:45599 req_id = 1c12370b-cb82-47d4-b4bd-9d8720c3e90c response_code = 200 uri = /config
692026-03-24T18:30:02.167ZINFOdns-server (http): request completed latency_us = 32963 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:49121 req_id = 89a7bcb8-c5c9-43e6-a7df-25c11e45654f response_code = 200 uri = /config
702026-03-24T18:30:02.199ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:36549
712026-03-24T18:30:02.204ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1d933d6e-5f9d-4b2a-bebd-66f45388d59e
722026-03-24T18:30:02.204ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1d933d6e-5f9d-4b2a-bebd-66f45388d59e
732026-03-24T18:30:02.204ZINFOdns-server (http): request completed latency_us = 2999 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:36549 req_id = 1d933d6e-5f9d-4b2a-bebd-66f45388d59e response_code = 204 uri = /config