Max level shown:
1 [ Sep 3 02:11:48 Enabled. ]
2 [ Sep 3 02:11:48 Rereading configuration. ]
3 [ Sep 3 02:11:48 Rereading configuration. ]
4 [ Sep 3 02:11:50 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:1::1]:5353 --dns-address [fd00:1122:3344:1::1]:53 &"). ]
5 [ Sep 3 02:11:50 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-09-03T02:11:50.086ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:1::1]:53 }
92026-09-03T02:11:50.086ZINFOdns-server (store): opening sled database path = /data/dns
102026-09-03T02:11:50.111ZINFOdns-server (store): pruning trees for generations newer than 0
112026-09-03T02:11:50.111ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-09-03T02:11:50.111ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:1::1]:53
132026-09-03T02:11:50.112ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:1::1]:5353
142026-09-03T02:11:50.166ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:1::2]:58179
152026-09-03T02:11:50.167ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = ff1ac087-5642-42dd-9056-4ab5665cad55
162026-09-03T02:11:50.167ZINFOdns-server (store): pruning trees for generations newer than 0
172026-09-03T02:11:50.182ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-09-03T02:11:50.182ZINFOdns-server (store): updated generation new_generation = 1 req_id = ff1ac087-5642-42dd-9056-4ab5665cad55
192026-09-03T02:11:50.182ZINFOdns-server (http): request completed latency_us = 15821 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:1::2]:58179 req_id = ff1ac087-5642-42dd-9056-4ab5665cad55 response_code = 204 uri = /config
202026-09-03T02:12:02.629ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12154, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:48112 req_id = 09a9edc8-21de-45ac-8101-5ee7b2468e10
212026-09-03T02:12:02.634ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43943, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:50335 req_id = 59522606-a35e-48c6-8216-0834b39047e0
222026-09-03T02:12:02.638ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44764, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:40581 req_id = 84b09eb1-ae97-4834-b577-1f4e15498ada
232026-09-03T02:13:06.411ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47822, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), ), original: Query { name: Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 97, 57, 97, 51, 57, 53, 101, 49, 45, 52, 55, 54, 57, 45, 52, 54, 52, 53, 45, 98, 98, 102, 51, 45, 54, 55, 54, 97, 57, 53, 97, 57, 56, 53, 56, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581." peer_addr = [fd00:1122:3344:101::e]:36837 req_id = 9f060bb1-a6c0-492b-940d-41d910b3eb40
242026-09-03T02:13:06.414ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47822, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), ), original: Query { name: Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 97, 57, 97, 51, 57, 53, 101, 49, 45, 52, 55, 54, 57, 45, 52, 54, 52, 53, 45, 98, 98, 102, 51, 45, 54, 55, 54, 97, 57, 53, 97, 57, 56, 53, 56, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581." peer_addr = [fd00:1122:3344:101::e]:50635 req_id = 68821b53-cff6-45f8-8f42-506a3b14b8cf
252026-09-03T02:13:10.199ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28597, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:65033 req_id = 713c7de6-f749-4b27-9fcb-a1530b074448
262026-09-03T02:13:10.226ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22277, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:8810 req_id = cdb6b9a6-0f1e-4234-8d19-7214f36bb3e8
272026-09-03T02:13:11.214ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:52446
282026-09-03T02:13:11.214ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:55011
292026-09-03T02:13:11.220ZINFOdns-server (http): request completed latency_us = 5835 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:55011 req_id = 3b798d3b-bd23-40ce-b66e-50b6bfb8cc66 response_code = 200 uri = /config
302026-09-03T02:13:11.221ZINFOdns-server (http): request completed latency_us = 5523 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:52446 req_id = 9934b562-7cb2-49cb-b8b4-103a7e778d31 response_code = 200 uri = /config
312026-09-03T02:13:11.840ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35288, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:51580 req_id = 23b17c0f-ee9e-42ea-a0f5-683639bb38b9
322026-09-03T02:13:11.845ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27240, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:30555 req_id = 47f9ce6b-32d0-40fd-9189-6ee7362ef968
332026-09-03T02:13:12.259ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:38468
342026-09-03T02:13:12.259ZINFOdns-server (http): request completed latency_us = 294 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:38468 req_id = bf608814-d4fc-4ef1-b688-be386c937c54 response_code = 200 uri = /config
352026-09-03T02:13:12.327ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:53280
362026-09-03T02:13:12.327ZINFOdns-server (http): request completed latency_us = 213 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:53280 req_id = f667a63e-9723-41c6-adb0-a03dcf1bdf37 response_code = 200 uri = /config
372026-09-03T02:13:13.474ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:64820
382026-09-03T02:13:13.477ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20342, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:57630 req_id = f6a53f7a-e252-401f-b5bd-ef021d7ffe4d
392026-09-03T02:13:13.478ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 37f4f604-f3c6-46b9-8fcb-3702688e4423
402026-09-03T02:13:13.478ZINFOdns-server (store): updated generation new_generation = 1 req_id = 37f4f604-f3c6-46b9-8fcb-3702688e4423
412026-09-03T02:13:13.478ZINFOdns-server (http): request completed latency_us = 360 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:64820 req_id = 37f4f604-f3c6-46b9-8fcb-3702688e4423 response_code = 204 uri = /config
422026-09-03T02:13:13.735ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37387
432026-09-03T02:13:13.735ZINFOdns-server (http): request completed latency_us = 238 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:37387 req_id = 0bef912d-02e0-435f-8e98-1fa48e6baf6e response_code = 200 uri = /config
442026-09-03T02:13:14.640ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1980, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:10994 req_id = 4e4fced6-0a52-43aa-a640-85b251214ef2
452026-09-03T02:13:14.763ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:49578
462026-09-03T02:13:14.763ZINFOdns-server (http): request completed latency_us = 266 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:49578 req_id = 343f0379-5346-468c-b301-b1cb9e1aec4d response_code = 200 uri = /config
472026-09-03T02:13:20.338ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8438, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54023 req_id = 2e820fd6-701c-4aec-96f1-bffe5fe8fe58
482026-09-03T02:13:20.916ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10808, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:48975 req_id = c4f84707-eb2f-4c6e-a024-99ceb6532854
492026-09-03T02:13:21.029ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:41346
502026-09-03T02:13:21.029ZINFOdns-server (http): request completed latency_us = 256 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:41346 req_id = 101fe562-a452-4802-8069-7b6fcbe26def response_code = 200 uri = /config
512026-09-03T02:13:22.196ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35191, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:41684 req_id = fbfbe083-c210-4cac-bdc2-b1fa3bd1c905
522026-09-03T02:13:22.311ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:47629
532026-09-03T02:13:22.311ZINFOdns-server (http): request completed latency_us = 178 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:47629 req_id = 017cd0cb-3474-4b99-b780-d1312df80d59 response_code = 200 uri = /config
542026-09-03T02:13:30.339ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37178, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:60091 req_id = e9acaf2e-f560-4802-a529-1b697f40d8ad
552026-09-03T02:13:40.341ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28009, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:60957 req_id = f805f29a-e101-4698-baff-d65db318522f
562026-09-03T02:13:50.344ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43331, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53517 req_id = f96886bf-b9ac-4ab5-9188-ba8d3d84d550
572026-09-03T02:14:00.345ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2191, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59206 req_id = 009cdb43-f298-4f96-aa2b-509e458e937a
582026-09-03T02:14:02.813ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62099, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:34917 req_id = 40d834ae-b0a1-4609-a113-3abf2891b1bd
592026-09-03T02:14:02.818ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33106, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:48702 req_id = fed36d3c-9021-44a7-a705-6caf655e1e7d
602026-09-03T02:14:02.823ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1451, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:37200 req_id = 473860c5-d062-4844-8a0f-c2c15c29074c
612026-09-03T02:14:09.982ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:49159
622026-09-03T02:14:09.986ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6939fb16-06f0-4463-ad73-f93c1605ee80
632026-09-03T02:14:09.986ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6939fb16-06f0-4463-ad73-f93c1605ee80
642026-09-03T02:14:09.986ZINFOdns-server (http): request completed latency_us = 280 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:49159 req_id = 6939fb16-06f0-4463-ad73-f93c1605ee80 response_code = 204 uri = /config
652026-09-03T02:14:10.158ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:48697
662026-09-03T02:14:10.161ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 858211a2-4745-49f6-b092-93f495428c45
672026-09-03T02:14:10.161ZINFOdns-server (store): updated generation new_generation = 1 req_id = 858211a2-4745-49f6-b092-93f495428c45
682026-09-03T02:14:10.161ZINFOdns-server (http): request completed latency_us = 325 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:48697 req_id = 858211a2-4745-49f6-b092-93f495428c45 response_code = 204 uri = /config
692026-09-03T02:14:10.344ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9956, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61746 req_id = 0e9cd222-eed6-4486-beaf-1674f8769faf
702026-09-03T02:14:10.830ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10341, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:50812 req_id = 898529a0-f875-40da-836c-049c2ff72d30
712026-09-03T02:14:10.931ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:64482
722026-09-03T02:14:10.931ZINFOdns-server (http): request completed latency_us = 205 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:64482 req_id = 283101b6-3fa0-47db-b481-e918d9afe5ca response_code = 200 uri = /config
732026-09-03T02:14:11.317ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32325, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:50900 req_id = b27ee322-d53d-42f4-a81c-a01e7eb9ac74
742026-09-03T02:14:11.436ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:37750
752026-09-03T02:14:11.436ZINFOdns-server (http): request completed latency_us = 224 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:37750 req_id = 2b7a4585-1d59-4753-b177-04df102ebee2 response_code = 200 uri = /config
762026-09-03T02:14:11.485ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:38766
772026-09-03T02:14:11.488ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 377df00d-78e7-4c62-926b-cac6c3da7c76
782026-09-03T02:14:11.488ZINFOdns-server (store): updated generation new_generation = 1 req_id = 377df00d-78e7-4c62-926b-cac6c3da7c76
792026-09-03T02:14:11.488ZINFOdns-server (http): request completed latency_us = 261 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:38766 req_id = 377df00d-78e7-4c62-926b-cac6c3da7c76 response_code = 204 uri = /config
802026-09-03T02:14:12.198ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42075, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:56151 req_id = 2a82db58-3336-4806-bd7a-cf37bb07c048
812026-09-03T02:14:12.293ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:37818
822026-09-03T02:14:12.293ZINFOdns-server (http): request completed latency_us = 200 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:37818 req_id = 2c2fefdb-909b-476b-8bda-4c4691aaa869 response_code = 200 uri = /config
832026-09-03T02:14:20.345ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63834, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55094 req_id = abc4f4a8-a06e-42db-ad3b-22a58225ec39
842026-09-03T02:14:30.348ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38965, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53756 req_id = 29fc3d43-fcfc-4544-a3f5-f71a9e46a49b
852026-09-03T02:14:40.350ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6037, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63922 req_id = 00bc8563-d9d0-4e08-a5b3-0a4f208cf482
862026-09-03T02:14:50.352ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34535, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61636 req_id = a50de234-044f-4368-b66c-c8b538442412
872026-09-03T02:15:00.187ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44042, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:54863 req_id = d14b4c17-5c52-4819-a83a-1790022ab583
882026-09-03T02:15:00.188ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44042, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:58544 req_id = 2192d65c-6b96-478d-ad94-df1064b5c07f
892026-09-03T02:15:00.232ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50821, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_9a21353e-d1f7-49e8-bd46-6a3758a70116."), ), original: Query { name: Name("oxz_ntp_9a21353e-d1f7-49e8-bd46-6a3758a70116."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 57, 97, 50, 49, 51, 53, 51, 101, 45, 100, 49, 102, 55, 45, 52, 57, 101, 56, 45, 98, 100, 52, 54, 45, 54, 97, 51, 55, 53, 56, 97, 55, 48, 49, 49, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_9a21353e-d1f7-49e8-bd46-6a3758a70116." peer_addr = [fd00:1122:3344:101::1b]:45865 req_id = 2a34a4e8-3ab1-4695-b6a7-2f1cee97c401
902026-09-03T02:15:00.353ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 142, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57414 req_id = 866df703-ca8f-4dce-8cc3-cf17940d0f51
912026-09-03T02:15:00.382ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41112, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), ), original: Query { name: Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 97, 57, 97, 51, 57, 53, 101, 49, 45, 52, 55, 54, 57, 45, 52, 54, 52, 53, 45, 98, 98, 102, 51, 45, 54, 55, 54, 97, 57, 53, 97, 57, 56, 53, 56, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581." peer_addr = [fd00:1122:3344:101::e]:55862 req_id = d8f483b4-bf20-4858-90ef-683ae221d186
922026-09-03T02:15:00.383ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41112, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), ), original: Query { name: Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 97, 57, 97, 51, 57, 53, 101, 49, 45, 52, 55, 54, 57, 45, 52, 54, 52, 53, 45, 98, 98, 102, 51, 45, 54, 55, 54, 97, 57, 53, 97, 57, 56, 53, 56, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581." peer_addr = [fd00:1122:3344:101::e]:34651 req_id = 907b21ee-317e-4f4e-97fa-794fea111625
932026-09-03T02:15:00.417ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43944, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade."), ), original: Query { name: Name("oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 56, 101, 99, 50, 100, 49, 99, 45, 48, 55, 52, 52, 45, 52, 52, 53, 56, 45, 97, 97, 56, 100, 45, 50, 52, 54, 98, 50, 97, 50, 100, 52, 97, 100, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade." peer_addr = [fd00:1122:3344:101::3]:44190 req_id = 738db5e3-246b-49b0-bc0c-e57a94fed60b
942026-09-03T02:15:00.417ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43944, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade."), ), original: Query { name: Name("oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 56, 101, 99, 50, 100, 49, 99, 45, 48, 55, 52, 52, 45, 52, 52, 53, 56, 45, 97, 97, 56, 100, 45, 50, 52, 54, 98, 50, 97, 50, 100, 52, 97, 100, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade." peer_addr = [fd00:1122:3344:101::3]:40451 req_id = b7ce2c75-34e0-43c5-a72f-15987d0bf9e3
952026-09-03T02:15:00.420ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26499, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d."), ), original: Query { name: Name("oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 53, 50, 100, 50, 53, 48, 45, 99, 100, 99, 100, 45, 52, 100, 53, 54, 45, 57, 50, 56, 55, 45, 51, 102, 102, 99, 55, 56, 97, 99, 52, 101, 50, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d." peer_addr = [fd00:1122:3344:101::4]:37125 req_id = ffc40ad2-2062-465f-9330-c291c76d92d7
962026-09-03T02:15:00.421ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26499, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d."), ), original: Query { name: Name("oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 53, 50, 100, 50, 53, 48, 45, 99, 100, 99, 100, 45, 52, 100, 53, 54, 45, 57, 50, 56, 55, 45, 51, 102, 102, 99, 55, 56, 97, 99, 52, 101, 50, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d." peer_addr = [fd00:1122:3344:101::4]:40906 req_id = 12460fc5-e447-4971-aaca-c13735a41f9f
972026-09-03T02:15:00.458ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea."), ), original: Query { name: Name("oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 48, 49, 55, 100, 101, 97, 97, 45, 101, 101, 102, 55, 45, 52, 102, 48, 100, 45, 57, 102, 50, 49, 45, 49, 48, 52, 50, 54, 52, 57, 100, 51, 51, 101, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea." peer_addr = [fd00:1122:3344:101::6]:48294 req_id = 784d5fe2-0f25-4303-a4aa-1dbc6308cf7a
982026-09-03T02:15:00.459ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea."), ), original: Query { name: Name("oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 48, 49, 55, 100, 101, 97, 97, 45, 101, 101, 102, 55, 45, 52, 102, 48, 100, 45, 57, 102, 50, 49, 45, 49, 48, 52, 50, 54, 52, 57, 100, 51, 51, 101, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea." peer_addr = [fd00:1122:3344:101::6]:59479 req_id = dd3b3fdb-2575-421c-9485-5cd518926e60
992026-09-03T02:15:00.467ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31410, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf."), ), original: Query { name: Name("oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 55, 102, 50, 100, 101, 99, 52, 45, 99, 54, 50, 51, 45, 52, 53, 98, 97, 45, 57, 98, 52, 51, 45, 97, 101, 101, 55, 99, 51, 55, 100, 55, 57, 99, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf." peer_addr = [fd00:1122:3344:101::5]:52782 req_id = a708c59f-d197-4f48-a659-04cea2f7673f
1002026-09-03T02:15:00.467ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31410, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf."), ), original: Query { name: Name("oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 55, 102, 50, 100, 101, 99, 52, 45, 99, 54, 50, 51, 45, 52, 53, 98, 97, 45, 57, 98, 52, 51, 45, 97, 101, 101, 55, 99, 51, 55, 100, 55, 57, 99, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf." peer_addr = [fd00:1122:3344:101::5]:45634 req_id = 0ddd99b4-821e-4000-8bb5-933307c89bb5
1012026-09-03T02:15:00.489ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9954, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6."), ), original: Query { name: Name("oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 53, 55, 55, 57, 54, 51, 102, 45, 54, 56, 53, 52, 45, 52, 51, 101, 48, 45, 97, 57, 102, 100, 45, 55, 57, 50, 53, 57, 51, 98, 50, 97, 98, 99, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6." peer_addr = [fd00:1122:3344:101::7]:45664 req_id = 874d5cfa-bb8c-411e-bc45-28dd24ed852d
1022026-09-03T02:15:00.490ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9954, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6."), ), original: Query { name: Name("oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 53, 55, 55, 57, 54, 51, 102, 45, 54, 56, 53, 52, 45, 52, 51, 101, 48, 45, 97, 57, 102, 100, 45, 55, 57, 50, 53, 57, 51, 98, 50, 97, 98, 99, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6." peer_addr = [fd00:1122:3344:101::7]:39553 req_id = a633beb0-1d6a-4783-aa2c-6803c4f972ef