Max level shown:
1 [ Jul 2 21:43:26 Enabled. ]
2 [ Jul 2 21:43:26 Rereading configuration. ]
3 [ Jul 2 21:43:27 Rereading configuration. ]
4 [ Jul 2 21:43:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ Jul 2 21:43:28 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-07-02T21:43:28.493ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-07-02T21:43:28.493ZINFOdns-server (store): opening sled database path = /data/dns
102026-07-02T21:43:28.525ZINFOdns-server (store): pruning trees for generations newer than 0
112026-07-02T21:43:28.525ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-07-02T21:43:28.525ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-07-02T21:43:28.526ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-07-02T21:43:28.646ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21698, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:101::2]:54341 req_id = fd76a398-c036-4fa3-a4ee-2f946422bd20
152026-07-02T21:43:28.690ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:50787
162026-07-02T21:43:28.691ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e31c5ff1-564a-4c24-b3ed-6b7b36774898
172026-07-02T21:43:28.691ZINFOdns-server (store): pruning trees for generations newer than 0
182026-07-02T21:43:28.703ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
192026-07-02T21:43:28.703ZINFOdns-server (store): updated generation new_generation = 1 req_id = e31c5ff1-564a-4c24-b3ed-6b7b36774898
202026-07-02T21:43:28.703ZINFOdns-server (http): request completed latency_us = 12655 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:50787 req_id = e31c5ff1-564a-4c24-b3ed-6b7b36774898 response_code = 204 uri = /config
212026-07-02T21:43:40.487ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20652, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:36223 req_id = 1c207051-47be-4efb-ad18-5d1e951ed027
222026-07-02T21:43:40.492ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55966, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:49980 req_id = aa63b6f1-3442-4ef2-a4e3-9b966dcbdb82
232026-07-02T21:43:40.496ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56898, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:34489 req_id = 48114686-454f-4d22-b39e-151870bb479c
242026-07-02T21:44:52.195ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22225, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56020 req_id = 1149ff01-ea6a-4901-bb4b-8c7c53169a62
252026-07-02T21:44:56.092ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6047, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1."), ), original: Query { name: Name("oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 98, 101, 52, 50, 102, 97, 99, 48, 45, 101, 99, 102, 102, 45, 52, 53, 55, 99, 45, 97, 57, 99, 100, 45, 97, 51, 57, 102, 51, 55, 54, 101, 51, 51, 98, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1." peer_addr = [fd00:1122:3344:101::e]:65450 req_id = 3e148798-f003-49d7-b556-9d0226b74069
262026-07-02T21:44:56.098ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6047, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1."), ), original: Query { name: Name("oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 98, 101, 52, 50, 102, 97, 99, 48, 45, 101, 99, 102, 102, 45, 52, 53, 55, 99, 45, 97, 57, 99, 100, 45, 97, 51, 57, 102, 51, 55, 54, 101, 51, 51, 98, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1." peer_addr = [fd00:1122:3344:101::e]:36109 req_id = ccc07d58-380d-4917-9073-63dd82ee1014
272026-07-02T21:45:00.081ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28387, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1."), ), original: Query { name: Name("oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 98, 101, 52, 50, 102, 97, 99, 48, 45, 101, 99, 102, 102, 45, 52, 53, 55, 99, 45, 97, 57, 99, 100, 45, 97, 51, 57, 102, 51, 55, 54, 101, 51, 51, 98, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1." peer_addr = [fd00:1122:3344:101::e]:42136 req_id = 7fd44e95-8ee3-4c9f-a368-1fe54d1db438
282026-07-02T21:45:00.082ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28387, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1."), ), original: Query { name: Name("oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 98, 101, 52, 50, 102, 97, 99, 48, 45, 101, 99, 102, 102, 45, 52, 53, 55, 99, 45, 97, 57, 99, 100, 45, 97, 51, 57, 102, 51, 55, 54, 101, 51, 51, 98, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_be42fac0-ecff-457c-a9cd-a39f376e33b1." peer_addr = [fd00:1122:3344:101::e]:38201 req_id = bc12f7b6-5194-4742-b2bd-0423de0e75cc
292026-07-02T21:45:00.083ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16876, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_aa567d81-6397-4d85-9687-81a563037c15."), ), original: Query { name: Name("oxz_cockroachdb_aa567d81-6397-4d85-9687-81a563037c15."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 97, 53, 54, 55, 100, 56, 49, 45, 54, 51, 57, 55, 45, 52, 100, 56, 53, 45, 57, 54, 56, 55, 45, 56, 49, 97, 53, 54, 51, 48, 51, 55, 99, 49, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_aa567d81-6397-4d85-9687-81a563037c15." peer_addr = [fd00:1122:3344:101::3]:50040 req_id = 9ab29de0-a99d-4fae-b00c-d82325eccef4
302026-07-02T21:45:00.084ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16876, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_aa567d81-6397-4d85-9687-81a563037c15."), ), original: Query { name: Name("oxz_cockroachdb_aa567d81-6397-4d85-9687-81a563037c15."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 97, 53, 54, 55, 100, 56, 49, 45, 54, 51, 57, 55, 45, 52, 100, 56, 53, 45, 57, 54, 56, 55, 45, 56, 49, 97, 53, 54, 51, 48, 51, 55, 99, 49, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_aa567d81-6397-4d85-9687-81a563037c15." peer_addr = [fd00:1122:3344:101::3]:56042 req_id = 45ddee33-7f70-470f-856c-0c1f3ffaa2e2
312026-07-02T21:45:00.089ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44788, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_fcabe179-7e8a-423f-acff-fd1d00d19a50."), ), original: Query { name: Name("oxz_cockroachdb_fcabe179-7e8a-423f-acff-fd1d00d19a50."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 99, 97, 98, 101, 49, 55, 57, 45, 55, 101, 56, 97, 45, 52, 50, 51, 102, 45, 97, 99, 102, 102, 45, 102, 100, 49, 100, 48, 48, 100, 49, 57, 97, 53, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_fcabe179-7e8a-423f-acff-fd1d00d19a50." peer_addr = [fd00:1122:3344:101::4]:54754 req_id = 3db23f4c-b11b-4ca5-94cf-6bd2781f2ab3
322026-07-02T21:45:00.090ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44788, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_fcabe179-7e8a-423f-acff-fd1d00d19a50."), ), original: Query { name: Name("oxz_cockroachdb_fcabe179-7e8a-423f-acff-fd1d00d19a50."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 99, 97, 98, 101, 49, 55, 57, 45, 55, 101, 56, 97, 45, 52, 50, 51, 102, 45, 97, 99, 102, 102, 45, 102, 100, 49, 100, 48, 48, 100, 49, 57, 97, 53, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_fcabe179-7e8a-423f-acff-fd1d00d19a50." peer_addr = [fd00:1122:3344:101::4]:44643 req_id = e8bae1b3-0079-4ed2-a1da-122b2f8b0223
332026-07-02T21:45:00.525ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 15871, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_eaa29b63-e938-4515-bb0b-11500625120b."), ), original: Query { name: Name("oxz_ntp_eaa29b63-e938-4515-bb0b-11500625120b."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 101, 97, 97, 50, 57, 98, 54, 51, 45, 101, 57, 51, 56, 45, 52, 53, 49, 53, 45, 98, 98, 48, 98, 45, 49, 49, 53, 48, 48, 54, 50, 53, 49, 50, 48, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_eaa29b63-e938-4515-bb0b-11500625120b." peer_addr = [fd00:1122:3344:101::1b]:37515 req_id = 3bb0daf2-cdfd-45ed-9c50-ec92f11f9429
342026-07-02T21:45:00.758ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41795, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:64714 req_id = b321ceeb-cdd6-4097-87eb-a53002fb076c
352026-07-02T21:45:00.759ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41795, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:39916 req_id = 3343221d-097b-4da8-9eca-09deb0690bc5
362026-07-02T21:45:00.913ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47473, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1b9eb585-df21-4fea-a71b-6f549f9053da."), ), original: Query { name: Name("oxz_cockroachdb_1b9eb585-df21-4fea-a71b-6f549f9053da."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 98, 57, 101, 98, 53, 56, 53, 45, 100, 102, 50, 49, 45, 52, 102, 101, 97, 45, 97, 55, 49, 98, 45, 54, 102, 53, 52, 57, 102, 57, 48, 53, 51, 100, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1b9eb585-df21-4fea-a71b-6f549f9053da." peer_addr = [fd00:1122:3344:101::6]:34065 req_id = 1e45f51f-5701-4f6c-936c-52401f40a4f1
372026-07-02T21:45:00.914ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47473, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1b9eb585-df21-4fea-a71b-6f549f9053da."), ), original: Query { name: Name("oxz_cockroachdb_1b9eb585-df21-4fea-a71b-6f549f9053da."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 98, 57, 101, 98, 53, 56, 53, 45, 100, 102, 50, 49, 45, 52, 102, 101, 97, 45, 97, 55, 49, 98, 45, 54, 102, 53, 52, 57, 102, 57, 48, 53, 51, 100, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1b9eb585-df21-4fea-a71b-6f549f9053da." peer_addr = [fd00:1122:3344:101::6]:48996 req_id = a2b7deba-a6b6-4585-a63b-171f3b725b77
382026-07-02T21:45:00.979ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16675, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_92049c80-83b1-45f6-814f-c54278147b5d."), ), original: Query { name: Name("oxz_cockroachdb_92049c80-83b1-45f6-814f-c54278147b5d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 50, 48, 52, 57, 99, 56, 48, 45, 56, 51, 98, 49, 45, 52, 53, 102, 54, 45, 56, 49, 52, 102, 45, 99, 53, 52, 50, 55, 56, 49, 52, 55, 98, 53, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_92049c80-83b1-45f6-814f-c54278147b5d." peer_addr = [fd00:1122:3344:101::5]:58271 req_id = aa1b3fe0-746a-4451-b56b-595697d79d7c
392026-07-02T21:45:00.980ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16675, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_92049c80-83b1-45f6-814f-c54278147b5d."), ), original: Query { name: Name("oxz_cockroachdb_92049c80-83b1-45f6-814f-c54278147b5d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 50, 48, 52, 57, 99, 56, 48, 45, 56, 51, 98, 49, 45, 52, 53, 102, 54, 45, 56, 49, 52, 102, 45, 99, 53, 52, 50, 55, 56, 49, 52, 55, 98, 53, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_92049c80-83b1-45f6-814f-c54278147b5d." peer_addr = [fd00:1122:3344:101::5]:33888 req_id = bf6a54e7-fcad-44af-81b3-cb2b21c8a263
402026-07-02T21:45:01.006ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40637, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f54aa3d3-ec2f-41e4-8fa1-2efb9f5fb1c5."), ), original: Query { name: Name("oxz_cockroachdb_f54aa3d3-ec2f-41e4-8fa1-2efb9f5fb1c5."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 53, 52, 97, 97, 51, 100, 51, 45, 101, 99, 50, 102, 45, 52, 49, 101, 52, 45, 56, 102, 97, 49, 45, 50, 101, 102, 98, 57, 102, 53, 102, 98, 49, 99, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f54aa3d3-ec2f-41e4-8fa1-2efb9f5fb1c5." peer_addr = [fd00:1122:3344:101::7]:58960 req_id = 630b1335-1266-4698-9a89-857a4de463fe
412026-07-02T21:45:01.007ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40637, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f54aa3d3-ec2f-41e4-8fa1-2efb9f5fb1c5."), ), original: Query { name: Name("oxz_cockroachdb_f54aa3d3-ec2f-41e4-8fa1-2efb9f5fb1c5."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 53, 52, 97, 97, 51, 100, 51, 45, 101, 99, 50, 102, 45, 52, 49, 101, 52, 45, 56, 102, 97, 49, 45, 50, 101, 102, 98, 57, 102, 53, 102, 98, 49, 99, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f54aa3d3-ec2f-41e4-8fa1-2efb9f5fb1c5." peer_addr = [fd00:1122:3344:101::7]:48280 req_id = eb91d4b9-06bf-4f8e-b53a-0da0f3418d54