Max level shown:
1 [ Aug 19 01:27:26 Enabled. ]
2 [ Aug 19 01:27:26 Rereading configuration. ]
3 [ Aug 19 01:27:26 Rereading configuration. ]
4 [ Aug 19 01:27:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:1::1]:5353 --dns-address [fd00:1122:3344:1::1]:53 &"). ]
5 [ Aug 19 01:27:28 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-08-19T01:27:28.144ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:1::1]:53 }
92026-08-19T01:27:28.144ZINFOdns-server (store): opening sled database path = /data/dns
102026-08-19T01:27:28.163ZINFOdns-server (store): pruning trees for generations newer than 0
112026-08-19T01:27:28.163ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-08-19T01:27:28.163ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:1::1]:53
132026-08-19T01:27:28.163ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:1::1]:5353
142026-08-19T01:27:30.162ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:1::2]:47697
152026-08-19T01:27:30.163ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 2c4ac5b0-2ecd-4870-a60c-7a6918ff8c09
162026-08-19T01:27:30.163ZINFOdns-server (store): pruning trees for generations newer than 0
172026-08-19T01:27:30.186ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-08-19T01:27:30.186ZINFOdns-server (store): updated generation new_generation = 1 req_id = 2c4ac5b0-2ecd-4870-a60c-7a6918ff8c09
192026-08-19T01:27:30.186ZINFOdns-server (http): request completed latency_us = 22877 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:1::2]:47697 req_id = 2c4ac5b0-2ecd-4870-a60c-7a6918ff8c09 response_code = 204 uri = /config
202026-08-19T01:27:41.342ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9568, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:54790 req_id = 0cf7d40a-f339-4df1-8f31-828ac5e51658
212026-08-19T01:27:41.346ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22198, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59869 req_id = d7933dd4-afeb-4625-b4e6-ef438f9ac81b
222026-08-19T01:27:41.350ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1918, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:52271 req_id = 14f3e0c5-d836-4e2d-9387-1f6b204e1dc2
232026-08-19T01:29:29.366ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5810, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:50631 req_id = 89f3beec-8901-41c9-8af8-69166f143fe2
242026-08-19T01:29:29.392ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54355, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:51286 req_id = 21ab0228-4bd3-4eb9-8606-393ff8e5d711
252026-08-19T01:29:29.398ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20763, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:57338 req_id = e5785bf0-77be-4b9a-a8c6-565a4fe24f08
262026-08-19T01:29:34.547ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9188, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56816 req_id = a656695d-4dff-44ad-8517-33d6641bc27b
272026-08-19T01:29:35.893ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45507, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b."), ), original: Query { name: Name("oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 55, 98, 54, 54, 102, 53, 57, 45, 99, 52, 98, 102, 45, 52, 101, 97, 56, 45, 97, 54, 97, 55, 45, 55, 57, 101, 56, 49, 97, 57, 51, 49, 100, 55, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b." peer_addr = [fd00:1122:3344:101::e]:50380 req_id = ec479716-d2d9-4d37-8eb3-36fa1b05054c
282026-08-19T01:29:35.894ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45507, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b."), ), original: Query { name: Name("oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 55, 98, 54, 54, 102, 53, 57, 45, 99, 52, 98, 102, 45, 52, 101, 97, 56, 45, 97, 54, 97, 55, 45, 55, 57, 101, 56, 49, 97, 57, 51, 49, 100, 55, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b." peer_addr = [fd00:1122:3344:101::e]:34224 req_id = 8f0b7707-e56c-4bfc-9d91-c4d3a4a5c506
292026-08-19T01:29:44.548ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7394, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56669 req_id = c39d78f5-a6b5-40a9-a053-762f5f31fd69
302026-08-19T01:29:44.736ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4043, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:30919 req_id = 94488f40-172e-4c23-a451-051f1d65d959
312026-08-19T01:29:44.886ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21174, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:8221 req_id = 1511c366-cd49-4b1f-8ecf-28858da9798d
322026-08-19T01:29:44.889ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59406, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:48765 req_id = c6a0583a-6bd2-4682-a74b-204a44e267aa
332026-08-19T01:29:47.341ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61330, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:11094 req_id = ed57fb98-6a13-4164-a20e-7f3cd481f6da
342026-08-19T01:29:47.874ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:34293
352026-08-19T01:29:47.965ZINFOdns-server (http): request completed latency_us = 62549 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:34293 req_id = 648e4f5a-9312-43ed-b85b-3f2fb52c83e6 response_code = 200 uri = /config
362026-08-19T01:29:49.439ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:60102
372026-08-19T01:29:49.439ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1b6821fc-4d3f-45c8-b941-d3d446117b34
382026-08-19T01:29:49.440ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1b6821fc-4d3f-45c8-b941-d3d446117b34
392026-08-19T01:29:49.442ZINFOdns-server (http): request completed latency_us = 2393 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:60102 req_id = 1b6821fc-4d3f-45c8-b941-d3d446117b34 response_code = 204 uri = /config
402026-08-19T01:29:49.833ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14693, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:16730 req_id = 4445f180-22de-499f-9c3c-71b91a03a2b4
412026-08-19T01:29:50.071ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:52722
422026-08-19T01:29:50.071ZINFOdns-server (http): request completed latency_us = 224 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:52722 req_id = ff35dc65-70cb-4bc3-a4ff-db0d873aef46 response_code = 200 uri = /config
432026-08-19T01:29:50.872ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8045, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:44826 req_id = d149d63e-b46f-45c7-b480-dbff431f929c
442026-08-19T01:29:51.101ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:61061
452026-08-19T01:29:51.101ZINFOdns-server (http): request completed latency_us = 205 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:61061 req_id = e90d988f-c5f6-4671-98ca-2476e1faaccf response_code = 200 uri = /config
462026-08-19T01:29:54.549ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57083, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56217 req_id = 5930fb5c-ab43-4801-b883-57f4bfb564bf
472026-08-19T01:29:56.057ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38524, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:55084 req_id = 86133f88-7c9b-4de2-b933-a8c6fed5e2e9
482026-08-19T01:29:56.062ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16705, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:62430 req_id = f542724d-5830-4ae4-aab7-cfa57d4a59da
492026-08-19T01:29:56.205ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:54948
502026-08-19T01:29:56.205ZINFOdns-server (http): request completed latency_us = 182 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:54948 req_id = ceb8477f-2c86-46f0-b63e-2d18170f8810 response_code = 200 uri = /config
512026-08-19T01:29:56.274ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:52547
522026-08-19T01:29:56.274ZINFOdns-server (http): request completed latency_us = 302 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:52547 req_id = eb09f769-0eb9-458b-88c8-85c42d7cece0 response_code = 200 uri = /config
532026-08-19T01:30:00.142ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47057, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_14582a57-0a33-4667-a7bf-1c75475f1b5d."), ), original: Query { name: Name("oxz_cockroachdb_14582a57-0a33-4667-a7bf-1c75475f1b5d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 52, 53, 56, 50, 97, 53, 55, 45, 48, 97, 51, 51, 45, 52, 54, 54, 55, 45, 97, 55, 98, 102, 45, 49, 99, 55, 53, 52, 55, 53, 102, 49, 98, 53, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_14582a57-0a33-4667-a7bf-1c75475f1b5d." peer_addr = [fd00:1122:3344:101::7]:65214 req_id = c6e0c38d-8e6b-4192-8fc8-63fdede76519
542026-08-19T01:30:00.143ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47057, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_14582a57-0a33-4667-a7bf-1c75475f1b5d."), ), original: Query { name: Name("oxz_cockroachdb_14582a57-0a33-4667-a7bf-1c75475f1b5d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 52, 53, 56, 50, 97, 53, 55, 45, 48, 97, 51, 51, 45, 52, 54, 54, 55, 45, 97, 55, 98, 102, 45, 49, 99, 55, 53, 52, 55, 53, 102, 49, 98, 53, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_14582a57-0a33-4667-a7bf-1c75475f1b5d." peer_addr = [fd00:1122:3344:101::7]:53017 req_id = 77b3f789-0cae-4684-b960-e9384370e47a
552026-08-19T01:30:00.177ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63750, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8f339db8-5169-4262-b68e-6ce1a3f87d94."), ), original: Query { name: Name("oxz_cockroachdb_8f339db8-5169-4262-b68e-6ce1a3f87d94."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 102, 51, 51, 57, 100, 98, 56, 45, 53, 49, 54, 57, 45, 52, 50, 54, 50, 45, 98, 54, 56, 101, 45, 54, 99, 101, 49, 97, 51, 102, 56, 55, 100, 57, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8f339db8-5169-4262-b68e-6ce1a3f87d94." peer_addr = [fd00:1122:3344:101::6]:34395 req_id = 5268085f-48f3-4817-807d-808c569ed65e
562026-08-19T01:30:00.178ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63750, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8f339db8-5169-4262-b68e-6ce1a3f87d94."), ), original: Query { name: Name("oxz_cockroachdb_8f339db8-5169-4262-b68e-6ce1a3f87d94."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 102, 51, 51, 57, 100, 98, 56, 45, 53, 49, 54, 57, 45, 52, 50, 54, 50, 45, 98, 54, 56, 101, 45, 54, 99, 101, 49, 97, 51, 102, 56, 55, 100, 57, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8f339db8-5169-4262-b68e-6ce1a3f87d94." peer_addr = [fd00:1122:3344:101::6]:56204 req_id = 23665729-917a-47cd-b3cb-1713403ecffd
572026-08-19T01:30:00.352ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39721, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:60398 req_id = 64ac70f7-6097-4fbf-9110-82fc3f4128bc
582026-08-19T01:30:00.352ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39721, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:39163 req_id = 30e445f7-46a5-410b-9188-8708da8a0e1b
592026-08-19T01:30:00.365ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44168, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_87f38c7b-4250-4549-9b3c-b7c2e0e19503."), ), original: Query { name: Name("oxz_ntp_87f38c7b-4250-4549-9b3c-b7c2e0e19503."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 56, 55, 102, 51, 56, 99, 55, 98, 45, 52, 50, 53, 48, 45, 52, 53, 52, 57, 45, 57, 98, 51, 99, 45, 98, 55, 99, 50, 101, 48, 101, 49, 57, 53, 48, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_87f38c7b-4250-4549-9b3c-b7c2e0e19503." peer_addr = [fd00:1122:3344:101::1b]:60476 req_id = a3e47f01-730f-43e4-826b-016c169e86cb
602026-08-19T01:30:00.566ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35957, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b."), ), original: Query { name: Name("oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 55, 98, 54, 54, 102, 53, 57, 45, 99, 52, 98, 102, 45, 52, 101, 97, 56, 45, 97, 54, 97, 55, 45, 55, 57, 101, 56, 49, 97, 57, 51, 49, 100, 55, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b." peer_addr = [fd00:1122:3344:101::e]:56768 req_id = b3d46b96-c3ee-4437-8298-72a1dc00b78f
612026-08-19T01:30:00.566ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35957, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b."), ), original: Query { name: Name("oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 55, 98, 54, 54, 102, 53, 57, 45, 99, 52, 98, 102, 45, 52, 101, 97, 56, 45, 97, 54, 97, 55, 45, 55, 57, 101, 56, 49, 97, 57, 51, 49, 100, 55, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_77b66f59-c4bf-4ea8-a6a7-79e81a931d7b." peer_addr = [fd00:1122:3344:101::e]:63101 req_id = 19266ccf-799d-4e40-a3fa-839856f67216
622026-08-19T01:30:01.004ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_961d059d-6f7d-4470-aa38-04236e5e81f0."), ), original: Query { name: Name("oxz_cockroachdb_961d059d-6f7d-4470-aa38-04236e5e81f0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 54, 49, 100, 48, 53, 57, 100, 45, 54, 102, 55, 100, 45, 52, 52, 55, 48, 45, 97, 97, 51, 56, 45, 48, 52, 50, 51, 54, 101, 53, 101, 56, 49, 102, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_961d059d-6f7d-4470-aa38-04236e5e81f0." peer_addr = [fd00:1122:3344:101::3]:40586 req_id = 1642b54d-49fe-4751-9539-a51305e64c9f
632026-08-19T01:30:01.004ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_961d059d-6f7d-4470-aa38-04236e5e81f0."), ), original: Query { name: Name("oxz_cockroachdb_961d059d-6f7d-4470-aa38-04236e5e81f0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 54, 49, 100, 48, 53, 57, 100, 45, 54, 102, 55, 100, 45, 52, 52, 55, 48, 45, 97, 97, 51, 56, 45, 48, 52, 50, 51, 54, 101, 53, 101, 56, 49, 102, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_961d059d-6f7d-4470-aa38-04236e5e81f0." peer_addr = [fd00:1122:3344:101::3]:49154 req_id = cde61c99-cf13-44f1-aac9-232bfeb891f7
642026-08-19T01:30:01.020ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57719, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3ee4967a-f231-43d9-92e2-9aa659986009."), ), original: Query { name: Name("oxz_cockroachdb_3ee4967a-f231-43d9-92e2-9aa659986009."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 101, 101, 52, 57, 54, 55, 97, 45, 102, 50, 51, 49, 45, 52, 51, 100, 57, 45, 57, 50, 101, 50, 45, 57, 97, 97, 54, 53, 57, 57, 56, 54, 48, 48, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3ee4967a-f231-43d9-92e2-9aa659986009." peer_addr = [fd00:1122:3344:101::5]:35592 req_id = 2ea82b14-6e93-4da2-9f28-08ca5d1f6ab1
652026-08-19T01:30:01.021ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16249, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_fad61ffe-f245-4b43-bca0-c4b4be0ad668."), ), original: Query { name: Name("oxz_cockroachdb_fad61ffe-f245-4b43-bca0-c4b4be0ad668."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 97, 100, 54, 49, 102, 102, 101, 45, 102, 50, 52, 53, 45, 52, 98, 52, 51, 45, 98, 99, 97, 48, 45, 99, 52, 98, 52, 98, 101, 48, 97, 100, 54, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_fad61ffe-f245-4b43-bca0-c4b4be0ad668." peer_addr = [fd00:1122:3344:101::4]:49435 req_id = cf2ad494-79bb-4edd-a2a8-a4af10744c73
662026-08-19T01:30:01.021ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57719, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3ee4967a-f231-43d9-92e2-9aa659986009."), ), original: Query { name: Name("oxz_cockroachdb_3ee4967a-f231-43d9-92e2-9aa659986009."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 101, 101, 52, 57, 54, 55, 97, 45, 102, 50, 51, 49, 45, 52, 51, 100, 57, 45, 57, 50, 101, 50, 45, 57, 97, 97, 54, 53, 57, 57, 56, 54, 48, 48, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3ee4967a-f231-43d9-92e2-9aa659986009." peer_addr = [fd00:1122:3344:101::5]:40685 req_id = 73c6fbac-2720-455d-9e1d-8e3a39c09f48
672026-08-19T01:30:01.022ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16249, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_fad61ffe-f245-4b43-bca0-c4b4be0ad668."), ), original: Query { name: Name("oxz_cockroachdb_fad61ffe-f245-4b43-bca0-c4b4be0ad668."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 97, 100, 54, 49, 102, 102, 101, 45, 102, 50, 52, 53, 45, 52, 98, 52, 51, 45, 98, 99, 97, 48, 45, 99, 52, 98, 52, 98, 101, 48, 97, 100, 54, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_fad61ffe-f245-4b43-bca0-c4b4be0ad668." peer_addr = [fd00:1122:3344:101::4]:33442 req_id = d0a8612d-3fce-4904-a64d-61be7ac42d8b