Max level shown:
1 [ May 20 17:41:08 Enabled. ]
2 [ May 20 17:41:08 Rereading configuration. ]
3 [ May 20 17:41:09 Rereading configuration. ]
4 [ May 20 17:41:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ May 20 17:41:10 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-05-20T17:41:10.347ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-05-20T17:41:10.348ZINFOdns-server (store): opening sled database path = /data/dns
102026-05-20T17:41:10.367ZINFOdns-server (store): pruning trees for generations newer than 0
112026-05-20T17:41:10.367ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-05-20T17:41:10.367ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-05-20T17:41:10.368ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-05-20T17:41:10.545ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:60992
152026-05-20T17:41:10.546ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c233e86b-e1cf-445e-a0b4-55d349c7268e
162026-05-20T17:41:10.546ZINFOdns-server (store): pruning trees for generations newer than 0
172026-05-20T17:41:10.562ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-05-20T17:41:10.562ZINFOdns-server (store): updated generation new_generation = 1 req_id = c233e86b-e1cf-445e-a0b4-55d349c7268e
192026-05-20T17:41:10.563ZINFOdns-server (http): request completed latency_us = 17438 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:60992 req_id = c233e86b-e1cf-445e-a0b4-55d349c7268e response_code = 204 uri = /config
202026-05-20T17:41:22.748ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27099, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:55855 req_id = c5e0b161-cfe2-4d04-9e02-86c1af754082
212026-05-20T17:41:22.766ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31222, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:42440 req_id = cd51b621-a1a0-4c22-8296-f8e1eca6ac3c
222026-05-20T17:41:22.782ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24355, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35237 req_id = 8b76c28b-aaf0-441f-9baf-43bf9ec86109
232026-05-20T17:43:08.661ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56560, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:63508 req_id = a9b94e7a-8a8f-480b-a10e-4d922ddbf572
242026-05-20T17:43:08.908ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11442, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:62637 req_id = cb18df61-1049-448b-b3fd-2f73f5bf9043
252026-05-20T17:43:08.908ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64817, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:37345 req_id = a20db582-1c03-451d-b7dc-f0d14d71c923
262026-05-20T17:43:33.304ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63402, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61623 req_id = 0cf45e02-34cd-42c3-b183-5caea41d9645
272026-05-20T17:43:43.307ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28553, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54132 req_id = b978bc81-5a3a-4b83-a85b-016e3442774a
282026-05-20T17:43:43.515ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33571, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:11349 req_id = d86d524c-a04c-48dc-9ee3-4bda1bd2846f
292026-05-20T17:43:43.524ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2843, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:13887 req_id = cbbb0808-676d-4bba-87cb-9dacc9e5d2b4
302026-05-20T17:43:43.575ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26049, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:53879 req_id = b7097a36-a201-4b6d-a992-99f8cd3d2626
312026-05-20T17:43:45.312ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:61030
322026-05-20T17:43:45.381ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b3d6d76f-ed00-4cce-97ea-6267dbe51f46
332026-05-20T17:43:45.381ZINFOdns-server (store): updated generation new_generation = 1 req_id = b3d6d76f-ed00-4cce-97ea-6267dbe51f46
342026-05-20T17:43:45.381ZINFOdns-server (http): request completed latency_us = 29614 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:61030 req_id = b3d6d76f-ed00-4cce-97ea-6267dbe51f46 response_code = 204 uri = /config
352026-05-20T17:43:46.320ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36621, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6."), ), original: Query { name: Name("oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 97, 52, 97, 98, 54, 53, 98, 45, 57, 49, 102, 99, 45, 52, 52, 100, 52, 45, 97, 56, 98, 52, 45, 52, 55, 101, 101, 49, 52, 101, 56, 55, 100, 97, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6." peer_addr = [fd00:1122:3344:101::e]:56214 req_id = 0ef6c253-f229-461a-bdc1-26e78d8901f7
362026-05-20T17:43:46.320ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36621, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6."), ), original: Query { name: Name("oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 97, 52, 97, 98, 54, 53, 98, 45, 57, 49, 102, 99, 45, 52, 52, 100, 52, 45, 97, 56, 98, 52, 45, 52, 55, 101, 101, 49, 52, 101, 56, 55, 100, 97, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6." peer_addr = [fd00:1122:3344:101::e]:53651 req_id = 779d455d-115e-4be0-9cf1-59afa34f252d
372026-05-20T17:43:47.027ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:46563
382026-05-20T17:43:47.027ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:34488
392026-05-20T17:43:47.030ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:57791
402026-05-20T17:43:47.037ZINFOdns-server (http): request completed latency_us = 9150 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:34488 req_id = 196a8606-f35f-4880-a7a6-ae2793550085 response_code = 200 uri = /config
412026-05-20T17:43:47.037ZINFOdns-server (http): request completed latency_us = 9132 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:46563 req_id = cacea2c9-c6dc-4b8d-9101-6e6bccc6dc3f response_code = 200 uri = /config
422026-05-20T17:43:47.037ZINFOdns-server (http): request completed latency_us = 6622 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:57791 req_id = c5ea703a-b3aa-41ba-9310-02c62874d48b response_code = 200 uri = /config
432026-05-20T17:43:48.420ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10162, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:31355 req_id = 9e03ad4c-0fef-4ef5-9233-d89ddae007d0
442026-05-20T17:43:48.550ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:42944
452026-05-20T17:43:48.550ZINFOdns-server (http): request completed latency_us = 228 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:42944 req_id = 4ceb0718-0fcb-4904-8625-90ecb09a2375 response_code = 200 uri = /config
462026-05-20T17:43:49.199ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48175, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:18373 req_id = e529dea0-e014-43ce-a790-be2a95cd8f70
472026-05-20T17:43:49.323ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:59282
482026-05-20T17:43:49.324ZINFOdns-server (http): request completed latency_us = 212 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:59282 req_id = 36bc46f8-f054-49ea-9720-c8f5f33c03bd response_code = 200 uri = /config
492026-05-20T17:43:50.257ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55419, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:49592 req_id = d1ef1b4c-c517-4b2e-9249-966cfaf73820
502026-05-20T17:43:50.377ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:37104
512026-05-20T17:43:50.378ZINFOdns-server (http): request completed latency_us = 186 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:37104 req_id = fea94153-7077-4374-891c-73f5b8f9dfab response_code = 200 uri = /config
522026-05-20T17:43:53.309ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29826, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53718 req_id = 36441f27-3729-42ff-8d8b-d5ef97fc9864
532026-05-20T17:43:54.047ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49971, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:52682 req_id = 34238f1d-4c65-4788-834e-977f7694742c
542026-05-20T17:43:54.050ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33500, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:27451 req_id = 4e76d310-4428-49ab-a176-678d881365cf
552026-05-20T17:43:54.163ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:41115
562026-05-20T17:43:54.163ZINFOdns-server (http): request completed latency_us = 216 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:41115 req_id = 0d540ec9-4728-4472-8ebb-9dab0d386f7a response_code = 200 uri = /config
572026-05-20T17:43:54.213ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:63940
582026-05-20T17:43:54.213ZINFOdns-server (http): request completed latency_us = 186 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:63940 req_id = 8bec1c0c-8fe3-4842-929d-bd68aa3bcaaa response_code = 200 uri = /config
592026-05-20T17:44:03.310ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28716, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:60604 req_id = 76696d0e-aba9-47c6-bcae-61f54627095c
602026-05-20T17:44:13.311ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10406, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:64704 req_id = 839e9e86-3cbb-40d3-8c46-82681ac2caf3
612026-05-20T17:44:23.312ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47028, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56557 req_id = 9d661d1b-4596-4622-a64a-41dad0304386
622026-05-20T17:44:33.314ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63698, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56294 req_id = ae9530be-db8b-4f92-b158-bd9f131658fd
632026-05-20T17:44:43.171ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:34134
642026-05-20T17:44:43.173ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b42f23d7-a55a-4ba7-8824-f7e723fa9079
652026-05-20T17:44:43.173ZINFOdns-server (store): updated generation new_generation = 1 req_id = b42f23d7-a55a-4ba7-8824-f7e723fa9079
662026-05-20T17:44:43.173ZINFOdns-server (http): request completed latency_us = 331 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:34134 req_id = b42f23d7-a55a-4ba7-8824-f7e723fa9079 response_code = 204 uri = /config
672026-05-20T17:44:43.316ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27286, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61248 req_id = 1b57dcb3-6cc7-4d79-8b82-de67df5bbd58
682026-05-20T17:44:43.350ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:33667
692026-05-20T17:44:43.352ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 527763cd-195a-4eeb-acca-5999effb1de3
702026-05-20T17:44:43.352ZINFOdns-server (store): updated generation new_generation = 1 req_id = 527763cd-195a-4eeb-acca-5999effb1de3
712026-05-20T17:44:43.352ZINFOdns-server (http): request completed latency_us = 263 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:33667 req_id = 527763cd-195a-4eeb-acca-5999effb1de3 response_code = 204 uri = /config
722026-05-20T17:44:43.612ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:48074
732026-05-20T17:44:43.614ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = df6efa34-dc45-4d81-9898-04100daf62c7
742026-05-20T17:44:43.614ZINFOdns-server (store): updated generation new_generation = 1 req_id = df6efa34-dc45-4d81-9898-04100daf62c7
752026-05-20T17:44:43.614ZINFOdns-server (http): request completed latency_us = 268 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:48074 req_id = df6efa34-dc45-4d81-9898-04100daf62c7 response_code = 204 uri = /config
762026-05-20T17:44:44.542ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62266, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:28179 req_id = bcb04022-7bba-41bf-b719-60c7ed1e9e25
772026-05-20T17:44:44.604ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52543, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:33417 req_id = bc46a9ff-0a94-4533-be9f-11cff6b20c23
782026-05-20T17:44:44.643ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64734, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:19515 req_id = fa649eca-db17-485c-b96a-f742a6f28316
792026-05-20T17:44:44.713ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:33983
802026-05-20T17:44:44.714ZINFOdns-server (http): request completed latency_us = 216 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:33983 req_id = 48f475b8-0305-4145-a65f-501550e3634e response_code = 200 uri = /config
812026-05-20T17:44:44.758ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:37507
822026-05-20T17:44:44.759ZINFOdns-server (http): request completed latency_us = 208 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:37507 req_id = 016fea3e-f666-41e1-9a0d-63eeb800893c response_code = 200 uri = /config
832026-05-20T17:44:44.792ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:55088
842026-05-20T17:44:44.792ZINFOdns-server (http): request completed latency_us = 205 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:55088 req_id = dca508a4-765a-477c-a856-7f30dcb5268c response_code = 200 uri = /config
852026-05-20T17:44:53.317ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16418, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53766 req_id = c2d9bac7-ce07-4707-8500-d668d4bba630
862026-05-20T17:45:00.520ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62766, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6."), ), original: Query { name: Name("oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 97, 52, 97, 98, 54, 53, 98, 45, 57, 49, 102, 99, 45, 52, 52, 100, 52, 45, 97, 56, 98, 52, 45, 52, 55, 101, 101, 49, 52, 101, 56, 55, 100, 97, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6." peer_addr = [fd00:1122:3344:101::e]:58837 req_id = f9f58faa-8fbb-4c80-8681-ab8f7b78c741
872026-05-20T17:45:00.521ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62766, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6."), ), original: Query { name: Name("oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 97, 52, 97, 98, 54, 53, 98, 45, 57, 49, 102, 99, 45, 52, 52, 100, 52, 45, 97, 56, 98, 52, 45, 52, 55, 101, 101, 49, 52, 101, 56, 55, 100, 97, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_7a4ab65b-91fc-44d4-a8b4-47ee14e87da6." peer_addr = [fd00:1122:3344:101::e]:38346 req_id = d425a3fd-47b8-4a0e-a8aa-9d59da8b7f4f
882026-05-20T17:45:00.533ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33920, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7586000e-f4a7-4124-b93d-12c10be78835."), ), original: Query { name: Name("oxz_cockroachdb_7586000e-f4a7-4124-b93d-12c10be78835."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 53, 56, 54, 48, 48, 48, 101, 45, 102, 52, 97, 55, 45, 52, 49, 50, 52, 45, 98, 57, 51, 100, 45, 49, 50, 99, 49, 48, 98, 101, 55, 56, 56, 51, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7586000e-f4a7-4124-b93d-12c10be78835." peer_addr = [fd00:1122:3344:101::6]:51123 req_id = 5de071aa-6c90-42f9-8018-b7856a3036cc
892026-05-20T17:45:00.533ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33920, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7586000e-f4a7-4124-b93d-12c10be78835."), ), original: Query { name: Name("oxz_cockroachdb_7586000e-f4a7-4124-b93d-12c10be78835."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 53, 56, 54, 48, 48, 48, 101, 45, 102, 52, 97, 55, 45, 52, 49, 50, 52, 45, 98, 57, 51, 100, 45, 49, 50, 99, 49, 48, 98, 101, 55, 56, 56, 51, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7586000e-f4a7-4124-b93d-12c10be78835." peer_addr = [fd00:1122:3344:101::6]:43015 req_id = 6ed7a164-605c-4e6f-a4d7-08f3e9a1ddbf
902026-05-20T17:45:00.534ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 65012, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8f6c2038-0276-48af-83b0-341e150b5cee."), ), original: Query { name: Name("oxz_cockroachdb_8f6c2038-0276-48af-83b0-341e150b5cee."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 102, 54, 99, 50, 48, 51, 56, 45, 48, 50, 55, 54, 45, 52, 56, 97, 102, 45, 56, 51, 98, 48, 45, 51, 52, 49, 101, 49, 53, 48, 98, 53, 99, 101, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8f6c2038-0276-48af-83b0-341e150b5cee." peer_addr = [fd00:1122:3344:101::3]:55737 req_id = 14d7b8dc-9c06-421e-b1ff-7046def035c8
912026-05-20T17:45:00.535ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 65012, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8f6c2038-0276-48af-83b0-341e150b5cee."), ), original: Query { name: Name("oxz_cockroachdb_8f6c2038-0276-48af-83b0-341e150b5cee."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 102, 54, 99, 50, 48, 51, 56, 45, 48, 50, 55, 54, 45, 52, 56, 97, 102, 45, 56, 51, 98, 48, 45, 51, 52, 49, 101, 49, 53, 48, 98, 53, 99, 101, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8f6c2038-0276-48af-83b0-341e150b5cee." peer_addr = [fd00:1122:3344:101::3]:38688 req_id = ae051ee6-5064-41f3-939f-d9daf804579b
922026-05-20T17:45:00.604ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31275, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_d50ff9a3-c131-4fb1-ad96-db9f5a42ea6e."), ), original: Query { name: Name("oxz_cockroachdb_d50ff9a3-c131-4fb1-ad96-db9f5a42ea6e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 53, 48, 102, 102, 57, 97, 51, 45, 99, 49, 51, 49, 45, 52, 102, 98, 49, 45, 97, 100, 57, 54, 45, 100, 98, 57, 102, 53, 97, 52, 50, 101, 97, 54, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_d50ff9a3-c131-4fb1-ad96-db9f5a42ea6e." peer_addr = [fd00:1122:3344:101::7]:57013 req_id = f943d21f-8fb1-4e7e-96db-98ce838f8a8e
932026-05-20T17:45:00.605ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31275, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_d50ff9a3-c131-4fb1-ad96-db9f5a42ea6e."), ), original: Query { name: Name("oxz_cockroachdb_d50ff9a3-c131-4fb1-ad96-db9f5a42ea6e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 53, 48, 102, 102, 57, 97, 51, 45, 99, 49, 51, 49, 45, 52, 102, 98, 49, 45, 97, 100, 57, 54, 45, 100, 98, 57, 102, 53, 97, 52, 50, 101, 97, 54, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_d50ff9a3-c131-4fb1-ad96-db9f5a42ea6e." peer_addr = [fd00:1122:3344:101::7]:51087 req_id = 8f85d47a-2153-4794-9c5f-d3ca63b85829
942026-05-20T17:45:00.674ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11674, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_85c62a18-ccac-4cd8-9f0b-3ae5f9264aa4."), ), original: Query { name: Name("oxz_cockroachdb_85c62a18-ccac-4cd8-9f0b-3ae5f9264aa4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 53, 99, 54, 50, 97, 49, 56, 45, 99, 99, 97, 99, 45, 52, 99, 100, 56, 45, 57, 102, 48, 98, 45, 51, 97, 101, 53, 102, 57, 50, 54, 52, 97, 97, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_85c62a18-ccac-4cd8-9f0b-3ae5f9264aa4." peer_addr = [fd00:1122:3344:101::5]:44972 req_id = fa3d8387-db48-4db5-8aa0-cc6391076e2b
952026-05-20T17:45:00.674ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11674, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_85c62a18-ccac-4cd8-9f0b-3ae5f9264aa4."), ), original: Query { name: Name("oxz_cockroachdb_85c62a18-ccac-4cd8-9f0b-3ae5f9264aa4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 53, 99, 54, 50, 97, 49, 56, 45, 99, 99, 97, 99, 45, 52, 99, 100, 56, 45, 57, 102, 48, 98, 45, 51, 97, 101, 53, 102, 57, 50, 54, 52, 97, 97, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_85c62a18-ccac-4cd8-9f0b-3ae5f9264aa4." peer_addr = [fd00:1122:3344:101::5]:44730 req_id = 5ee89be0-c41c-427f-97e7-085283061aa8
962026-05-20T17:45:00.717ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30093, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ae2e19bc-8fe3-4d90-8cf1-b463b5020bcf."), ), original: Query { name: Name("oxz_cockroachdb_ae2e19bc-8fe3-4d90-8cf1-b463b5020bcf."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 101, 50, 101, 49, 57, 98, 99, 45, 56, 102, 101, 51, 45, 52, 100, 57, 48, 45, 56, 99, 102, 49, 45, 98, 52, 54, 51, 98, 53, 48, 50, 48, 98, 99, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ae2e19bc-8fe3-4d90-8cf1-b463b5020bcf." peer_addr = [fd00:1122:3344:101::4]:47143 req_id = 5c6691c4-c2cf-4f85-8d7a-60f8c5ca7f75
972026-05-20T17:45:00.717ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30093, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ae2e19bc-8fe3-4d90-8cf1-b463b5020bcf."), ), original: Query { name: Name("oxz_cockroachdb_ae2e19bc-8fe3-4d90-8cf1-b463b5020bcf."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 101, 50, 101, 49, 57, 98, 99, 45, 56, 102, 101, 51, 45, 52, 100, 57, 48, 45, 56, 99, 102, 49, 45, 98, 52, 54, 51, 98, 53, 48, 50, 48, 98, 99, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ae2e19bc-8fe3-4d90-8cf1-b463b5020bcf." peer_addr = [fd00:1122:3344:101::4]:61705 req_id = 3d1603f0-3a0d-4ac9-a4cc-ec7f4e6ca4a3
982026-05-20T17:45:01.048ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43835, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:52041 req_id = 06b6e8e7-0403-45ed-85e0-0cace8c44ec5
992026-05-20T17:45:01.049ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43835, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:40944 req_id = b5940e37-2f30-4936-8924-4ca6887acacf
1002026-05-20T17:45:01.201ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8566, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_6db77ceb-8bd9-4a4d-b008-5334c1e86c46."), ), original: Query { name: Name("oxz_ntp_6db77ceb-8bd9-4a4d-b008-5334c1e86c46."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 54, 100, 98, 55, 55, 99, 101, 98, 45, 56, 98, 100, 57, 45, 52, 97, 52, 100, 45, 98, 48, 48, 56, 45, 53, 51, 51, 52, 99, 49, 101, 56, 54, 99, 52, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_6db77ceb-8bd9-4a4d-b008-5334c1e86c46." peer_addr = [fd00:1122:3344:101::1b]:41257 req_id = 0f63b1c1-c45b-4ad6-85ef-116bdee183e9
1012026-05-20T17:45:03.319ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21850, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55087 req_id = 830df364-7b52-433b-813a-b0a33e26200a