Max level shown:
1 [ Aug 25 09:26:10 Enabled. ]
2 [ Aug 25 09:26:10 Rereading configuration. ]
3 [ Aug 25 09:26:11 Rereading configuration. ]
4 [ Aug 25 09:26:12 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Aug 25 09:26:12 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-08-25T09:26:12.628ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-08-25T09:26:12.628ZINFOdns-server (store): opening sled database path = /data/dns
102026-08-25T09:26:12.649ZINFOdns-server (store): pruning trees for generations newer than 0
112026-08-25T09:26:12.649ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-08-25T09:26:12.649ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-08-25T09:26:12.649ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-08-25T09:26:12.665ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:51448
152026-08-25T09:26:12.666ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = bb200bd6-97c2-4828-8379-bb68724bf5e3
162026-08-25T09:26:12.666ZINFOdns-server (store): pruning trees for generations newer than 0
172026-08-25T09:26:12.688ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-08-25T09:26:12.688ZINFOdns-server (store): updated generation new_generation = 1 req_id = bb200bd6-97c2-4828-8379-bb68724bf5e3
192026-08-25T09:26:12.688ZINFOdns-server (http): request completed latency_us = 22609 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:51448 req_id = bb200bd6-97c2-4828-8379-bb68724bf5e3 response_code = 204 uri = /config
202026-08-25T09:26:24.097ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55557, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35122 req_id = 3dbcb669-9ebf-4521-8b8c-d7bb55e60997
212026-08-25T09:26:24.102ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45219, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:41378 req_id = 13575262-d98b-49c3-b77e-13896faef6b4
222026-08-25T09:26:24.108ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19362, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:60955 req_id = 3dab6225-24f4-4d80-8ae0-888880b41f82
232026-08-25T09:27:47.407ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49890, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:41182 req_id = 52979e5b-fad5-4566-9790-062e68af48e0
242026-08-25T09:27:47.412ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32139, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:52923 req_id = a8ad07b3-f10f-4d17-8fa6-f0e80caf494d
252026-08-25T09:27:47.416ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41929, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59157 req_id = f98d83e8-21d7-472e-b25d-5bbea2baa05a
262026-08-25T09:29:26.862ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30922, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61606 req_id = 9755fb48-ac7b-49fb-94fe-45ca548589ad
272026-08-25T09:29:28.538ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58699, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), ), original: Query { name: Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 49, 56, 53, 51, 98, 49, 49, 45, 102, 56, 99, 98, 45, 52, 49, 101, 56, 45, 97, 98, 51, 49, 45, 48, 54, 57, 54, 50, 51, 50, 56, 54, 53, 52, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545." peer_addr = [fd00:1122:3344:101::e]:59817 req_id = 1a0014ff-1053-4e3f-9ebf-00150abb77eb
282026-08-25T09:29:28.539ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58699, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), ), original: Query { name: Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 49, 56, 53, 51, 98, 49, 49, 45, 102, 56, 99, 98, 45, 52, 49, 101, 56, 45, 97, 98, 51, 49, 45, 48, 54, 57, 54, 50, 51, 50, 56, 54, 53, 52, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545." peer_addr = [fd00:1122:3344:101::e]:64007 req_id = a9d5c1ee-db21-46ee-9083-f40035cb4a8f
292026-08-25T09:29:36.832ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46817, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:50903 req_id = 95beb549-9d32-487a-9415-2e0a1dcf172f
302026-08-25T09:29:37.273ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27209, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:22366 req_id = f86393c9-614d-485f-a692-af33d4cffbb4
312026-08-25T09:29:38.402ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38698, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:32267 req_id = 6d30b035-e3fb-49b2-bad7-0775259a0584
322026-08-25T09:29:38.418ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5711, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:59069 req_id = 8993a7b9-abac-499d-a953-beaf2cc237d1
332026-08-25T09:29:40.147ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:62151
342026-08-25T09:29:40.151ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:43093
352026-08-25T09:29:40.151ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:32958
362026-08-25T09:29:40.185ZINFOdns-server (http): request completed latency_us = 17984 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:43093 req_id = 4874ca4e-94ab-4b1e-8bcf-ef1b808bfa2c response_code = 200 uri = /config
372026-08-25T09:29:40.185ZINFOdns-server (http): request completed latency_us = 17992 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:32958 req_id = dc3a8143-3c94-41c9-a87d-290d8c663d06 response_code = 200 uri = /config
382026-08-25T09:29:40.185ZINFOdns-server (http): request completed latency_us = 18075 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:62151 req_id = 3d015be8-c2c1-4259-8f45-d6e324187ff6 response_code = 200 uri = /config
392026-08-25T09:29:40.577ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:38378
402026-08-25T09:29:40.578ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 016da613-7367-45cf-a96c-ef4525fcf961
412026-08-25T09:29:40.578ZINFOdns-server (store): updated generation new_generation = 1 req_id = 016da613-7367-45cf-a96c-ef4525fcf961
422026-08-25T09:29:40.578ZINFOdns-server (http): request completed latency_us = 293 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:38378 req_id = 016da613-7367-45cf-a96c-ef4525fcf961 response_code = 204 uri = /config
432026-08-25T09:29:41.590ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48634, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:61381 req_id = caf39e7d-2056-4a47-8b5f-fa01f145b80e
442026-08-25T09:29:41.840ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37274
452026-08-25T09:29:41.840ZINFOdns-server (http): request completed latency_us = 215 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:37274 req_id = 5c488844-f959-4555-9eeb-79683e225c4e response_code = 200 uri = /config
462026-08-25T09:29:42.498ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12593, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:45661 req_id = 93966268-8f3d-48a7-bab5-33c2f8f9a3c0
472026-08-25T09:29:42.764ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:64154
482026-08-25T09:29:42.764ZINFOdns-server (http): request completed latency_us = 191 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:64154 req_id = 2c7a0500-103f-4832-b1b3-1f13b49e9ef3 response_code = 200 uri = /config
492026-08-25T09:29:43.271ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59435, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:46338 req_id = ba76fa8d-8f41-4fcb-b394-9e2ff0fdf90a
502026-08-25T09:29:43.403ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:47664
512026-08-25T09:29:43.403ZINFOdns-server (http): request completed latency_us = 202 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:47664 req_id = f512b992-a225-4463-8dd4-d7f905ed2a72 response_code = 200 uri = /config
522026-08-25T09:29:46.834ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16163, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:51070 req_id = 04bb52a5-66d7-4724-bd55-2963f6e39c11
532026-08-25T09:29:48.182ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63290, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:30232 req_id = e6e8b9a3-3ff4-4828-b82d-dc88c902f0c0
542026-08-25T09:29:48.316ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:51510
552026-08-25T09:29:48.317ZINFOdns-server (http): request completed latency_us = 197 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:51510 req_id = 307a7098-7640-45cb-b8cc-ade337cfac9d response_code = 200 uri = /config
562026-08-25T09:29:49.331ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49040, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:53489 req_id = a0316492-a794-41ec-800e-e688d4797ee8
572026-08-25T09:29:49.460ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:52610
582026-08-25T09:29:49.460ZINFOdns-server (http): request completed latency_us = 199 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:52610 req_id = f0a70628-2bcc-4114-a811-7b09bdd65cbd response_code = 200 uri = /config
592026-08-25T09:29:56.836ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59166, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53606 req_id = 24ed5b1b-3709-494a-8eb6-8919005afa18
602026-08-25T09:30:00.068ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51267, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_3c73a37a-8db4-47f7-95ab-e59b4345c1a2."), ), original: Query { name: Name("oxz_ntp_3c73a37a-8db4-47f7-95ab-e59b4345c1a2."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 51, 99, 55, 51, 97, 51, 55, 97, 45, 56, 100, 98, 52, 45, 52, 55, 102, 55, 45, 57, 53, 97, 98, 45, 101, 53, 57, 98, 52, 51, 52, 53, 99, 49, 97, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_3c73a37a-8db4-47f7-95ab-e59b4345c1a2." peer_addr = [fd00:1122:3344:101::1b]:47605 req_id = 0bb0935a-949b-412b-b3a3-49a08eaa21fb
612026-08-25T09:30:00.160ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12380, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8."), ), original: Query { name: Name("oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 97, 102, 97, 101, 48, 97, 100, 45, 54, 50, 54, 102, 45, 52, 97, 97, 53, 45, 57, 53, 51, 100, 45, 53, 50, 52, 53, 101, 55, 56, 100, 102, 50, 98, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8." peer_addr = [fd00:1122:3344:101::4]:33733 req_id = 77c3194f-f997-4906-bb3f-8df5941602f5
622026-08-25T09:30:00.161ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12380, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8."), ), original: Query { name: Name("oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 97, 102, 97, 101, 48, 97, 100, 45, 54, 50, 54, 102, 45, 52, 97, 97, 53, 45, 57, 53, 51, 100, 45, 53, 50, 52, 53, 101, 55, 56, 100, 102, 50, 98, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8." peer_addr = [fd00:1122:3344:101::4]:33992 req_id = 04e0cac6-2e55-468b-8758-24c40fc38c9c
632026-08-25T09:30:00.246ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37409, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), ), original: Query { name: Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 49, 56, 53, 51, 98, 49, 49, 45, 102, 56, 99, 98, 45, 52, 49, 101, 56, 45, 97, 98, 51, 49, 45, 48, 54, 57, 54, 50, 51, 50, 56, 54, 53, 52, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545." peer_addr = [fd00:1122:3344:101::e]:55474 req_id = 48228387-d5b9-4c05-9102-15aae7591647
642026-08-25T09:30:00.247ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37409, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), ), original: Query { name: Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 49, 56, 53, 51, 98, 49, 49, 45, 102, 56, 99, 98, 45, 52, 49, 101, 56, 45, 97, 98, 51, 49, 45, 48, 54, 57, 54, 50, 51, 50, 56, 54, 53, 52, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545." peer_addr = [fd00:1122:3344:101::e]:33622 req_id = 9a063f59-f81d-4075-9ce4-bbbdab7c1951
652026-08-25T09:30:00.513ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54820, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:49272 req_id = a7c4edce-e39c-43d1-bd62-6d7b09d495f3
662026-08-25T09:30:00.514ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54820, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:45014 req_id = 47a2a0a2-bc12-4ac4-b57b-caee42e34a0c
672026-08-25T09:30:00.950ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52022, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc."), ), original: Query { name: Name("oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 99, 48, 98, 102, 98, 55, 55, 45, 56, 98, 53, 50, 45, 52, 52, 101, 99, 45, 97, 57, 53, 57, 45, 51, 99, 53, 55, 102, 55, 102, 51, 50, 57, 98, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc." peer_addr = [fd00:1122:3344:101::7]:41275 req_id = 77c97b2f-fea4-4f30-aef6-2b22d32cdc41
682026-08-25T09:30:00.951ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52022, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc."), ), original: Query { name: Name("oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 99, 48, 98, 102, 98, 55, 55, 45, 56, 98, 53, 50, 45, 52, 52, 101, 99, 45, 97, 57, 53, 57, 45, 51, 99, 53, 55, 102, 55, 102, 51, 50, 57, 98, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc." peer_addr = [fd00:1122:3344:101::7]:64632 req_id = 0179dd95-7997-4c08-819d-2a586123b35b
692026-08-25T09:30:00.975ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37040, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e."), ), original: Query { name: Name("oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 51, 100, 99, 98, 56, 54, 101, 45, 99, 54, 54, 98, 45, 52, 102, 48, 97, 45, 97, 101, 97, 101, 45, 54, 55, 100, 98, 57, 55, 51, 49, 55, 57, 51, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e." peer_addr = [fd00:1122:3344:101::6]:33897 req_id = 66a20da9-3911-4f63-936f-c82c13ada587
702026-08-25T09:30:00.976ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37040, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e."), ), original: Query { name: Name("oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 51, 100, 99, 98, 56, 54, 101, 45, 99, 54, 54, 98, 45, 52, 102, 48, 97, 45, 97, 101, 97, 101, 45, 54, 55, 100, 98, 57, 55, 51, 49, 55, 57, 51, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e." peer_addr = [fd00:1122:3344:101::6]:44604 req_id = 06157a31-ec9f-4089-be66-018d4c09e775
712026-08-25T09:30:00.979ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4430, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f."), ), original: Query { name: Name("oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 52, 55, 52, 99, 99, 50, 55, 45, 56, 97, 55, 50, 45, 52, 56, 100, 102, 45, 97, 49, 56, 97, 45, 49, 98, 49, 99, 101, 54, 48, 49, 57, 51, 54, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f." peer_addr = [fd00:1122:3344:101::5]:61177 req_id = afbd1759-e420-4e8e-b943-3bac1ac9b2f0
722026-08-25T09:30:00.980ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4430, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f."), ), original: Query { name: Name("oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 52, 55, 52, 99, 99, 50, 55, 45, 56, 97, 55, 50, 45, 52, 56, 100, 102, 45, 97, 49, 56, 97, 45, 49, 98, 49, 99, 101, 54, 48, 49, 57, 51, 54, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f." peer_addr = [fd00:1122:3344:101::5]:37093 req_id = 23f4b9c6-19cf-4f3f-8966-000b71ff9802
732026-08-25T09:30:01.011ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55805, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616."), ), original: Query { name: Name("oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 98, 100, 57, 55, 100, 50, 55, 45, 54, 98, 48, 99, 45, 52, 98, 50, 98, 45, 57, 97, 97, 54, 45, 57, 99, 48, 99, 56, 97, 51, 54, 102, 54, 49, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616." peer_addr = [fd00:1122:3344:101::3]:38458 req_id = efc9196a-b57c-46b7-a73a-127c0a1a385b
742026-08-25T09:30:01.012ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55805, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616."), ), original: Query { name: Name("oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 98, 100, 57, 55, 100, 50, 55, 45, 54, 98, 48, 99, 45, 52, 98, 50, 98, 45, 57, 97, 97, 54, 45, 57, 99, 48, 99, 56, 97, 51, 54, 102, 54, 49, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616." peer_addr = [fd00:1122:3344:101::3]:43095 req_id = a9535704-65c7-48d8-8f55-bc54b2cd681b