Max level shown:
1 [ Oct 27 05:26:18 Enabled. ]
2 [ Oct 27 05:26:18 Rereading configuration. ]
3 [ Oct 27 05:26:19 Rereading configuration. ]
4 [ Oct 27 05:26:20 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:1::1]:5353 --dns-addresses [fd00:1122:3344:1::1]:53 &"). ]
5 [ Oct 27 05:26:20 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-10-27T05:26:20.475ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_addresses: [[fd00:1122:3344:1::1]:53] }
92026-10-27T05:26:20.475ZINFOdns-server (store): opening sled database path = /data/dns
102026-10-27T05:26:20.496ZINFOdns-server (store): pruning trees for generations newer than 0
112026-10-27T05:26:20.496ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-10-27T05:26:20.496ZINFOdns-server (dns): DNS server bound to address bind_address = [fd00:1122:3344:1::1]:53
132026-10-27T05:26:20.496ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:1::1]:5353
142026-10-27T05:26:20.507ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:1::2]:52839
152026-10-27T05:26:20.507ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = cb5ba3ef-d0c2-4a0a-bbc3-d863886f55b1
162026-10-27T05:26:20.507ZINFOdns-server (store): pruning trees for generations newer than 0
172026-10-27T05:26:20.522ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-10-27T05:26:20.522ZINFOdns-server (store): updated generation new_generation = 1 req_id = cb5ba3ef-d0c2-4a0a-bbc3-d863886f55b1
192026-10-27T05:26:20.522ZINFOdns-server (http): request completed latency_us = 15415 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:1::2]:52839 req_id = cb5ba3ef-d0c2-4a0a-bbc3-d863886f55b1 response_code = 204 uri = /config
202026-10-27T05:26:32.596ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62700, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::1b]:57161 req_id = cc05b89c-60ff-4f41-8e03-26e1d4a50101
212026-10-27T05:26:32.600ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25982, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::1b]:43671 req_id = 7c391be8-19d9-4f83-a609-432ca7d02f7e
222026-10-27T05:26:32.605ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23885, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::1b]:53521 req_id = 2cd83f38-266d-4bda-b3c3-55dc6df03b00
232026-10-27T05:27:40.643ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33941, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:49240 req_id = 2bb84f69-2c60-4688-9082-aa817540f9af
242026-10-27T05:27:50.630ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35848, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:60272 req_id = bcad9837-51df-45ba-918e-8152ecc572d6
252026-10-27T05:27:50.652ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19720, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::a]:38559 req_id = 2d424469-6e7b-478f-ae8a-6a1f0e2eccd3
262026-10-27T05:27:51.543ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52953, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::b]:4166 req_id = 0908afbb-e0cf-496c-8fc9-601314e7598a
272026-10-27T05:27:51.863ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28987, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::c]:4290 req_id = f8ea14dc-0930-4833-aee7-a47ffdf0737c
282026-10-27T05:27:55.201ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46926, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::e]:53128 req_id = 4c7b9c86-c224-4dc6-a675-b2bf2897238e
292026-10-27T05:27:55.225ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46926, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::e]:60693 req_id = 849eac96-8241-4f4e-a5bc-02086d7ee156
302026-10-27T05:27:57.843ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58481, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:58438 req_id = c68dbec6-d99c-4110-96e5-db058b061667
312026-10-27T05:27:58.506ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:53708 req_id = cc8e60d1-e7ad-42bd-97bb-59a58b60e0db
322026-10-27T05:27:59.106ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7221, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:51759 req_id = 8ce6e500-6c6e-4702-a421-1703e7b6a2f9
332026-10-27T05:28:01.591ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24639, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:54371 req_id = a3dece99-cfe0-45e0-8a87-c13f9ece873c
342026-10-27T05:28:05.615ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50437, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:52772 req_id = 5600a203-5632-4a4e-a0a8-f153503e1cfa
352026-10-27T05:28:11.838ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49310, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:63915 req_id = cb2b34ea-87b0-4f86-a4bd-bf5732a7ac7e
362026-10-27T05:28:19.116ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54994, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::1b]:42814 req_id = 72ff0325-866c-459e-aa3c-e1c838611c18
372026-10-27T05:28:19.122ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52049, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::1b]:45176 req_id = c31d657e-8cf6-4d4e-96a7-7e5bf00dcb32
382026-10-27T05:28:19.126ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22616, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::1b]:43441 req_id = 53223c00-df2b-47e1-a066-a6b4ed9eb418
392026-10-27T05:28:21.838ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19539, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:53423 req_id = dc266b44-a7bb-41cc-b104-44f1500b73e6
402026-10-27T05:28:40.592ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50870, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::c]:3847 req_id = cf50ec6e-ec36-4800-b413-fd3b15f759e8
412026-10-27T05:28:40.809ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:60480
422026-10-27T05:28:40.848ZINFOdns-server (http): request completed latency_us = 22935 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:60480 req_id = 0630c36e-26bb-466d-a37c-a998358840a7 response_code = 200 uri = /config
432026-10-27T05:28:50.070ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:44875
442026-10-27T05:28:50.073ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 707efb4f-59ad-4446-8e92-766d7be955d5
452026-10-27T05:28:50.073ZINFOdns-server (store): updated generation new_generation = 1 req_id = 707efb4f-59ad-4446-8e92-766d7be955d5
462026-10-27T05:28:50.073ZINFOdns-server (http): request completed latency_us = 271 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:44875 req_id = 707efb4f-59ad-4446-8e92-766d7be955d5 response_code = 204 uri = /config
472026-10-27T05:28:50.153ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42778, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::c]:28140 req_id = abcfc279-55b0-41fb-b24d-d34677b972ae
482026-10-27T05:28:50.283ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:60542
492026-10-27T05:28:50.284ZINFOdns-server (http): request completed latency_us = 239 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:60542 req_id = 60762ce6-8a32-46a2-bca2-c8e243a34116 response_code = 200 uri = /config
502026-10-27T05:28:50.666ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:38057
512026-10-27T05:28:50.669ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 664b6a29-b5cd-42f0-a649-41d695a4d3ad
522026-10-27T05:28:50.669ZINFOdns-server (store): updated generation new_generation = 1 req_id = 664b6a29-b5cd-42f0-a649-41d695a4d3ad
532026-10-27T05:28:50.669ZINFOdns-server (http): request completed latency_us = 333 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:38057 req_id = 664b6a29-b5cd-42f0-a649-41d695a4d3ad response_code = 204 uri = /config
542026-10-27T05:28:51.242ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18038, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::c]:15791 req_id = 3d912211-356c-4a87-bb70-1e14c5393d53
552026-10-27T05:28:51.386ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:51661
562026-10-27T05:28:51.386ZINFOdns-server (http): request completed latency_us = 426 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:51661 req_id = f9331bf8-e186-4e6f-b57c-3acadf538355 response_code = 200 uri = /config
572026-10-27T05:28:51.594ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:47506
582026-10-27T05:28:51.599ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3ca10d9e-5609-4efa-ba88-729f12aea32a
592026-10-27T05:28:51.599ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3ca10d9e-5609-4efa-ba88-729f12aea32a
602026-10-27T05:28:51.599ZINFOdns-server (http): request completed latency_us = 266 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:47506 req_id = 3ca10d9e-5609-4efa-ba88-729f12aea32a response_code = 204 uri = /config
612026-10-27T05:28:51.613ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:63185
622026-10-27T05:28:51.617ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 4fbb82b0-0385-44ac-acdf-f33eebf61518
632026-10-27T05:28:51.617ZINFOdns-server (store): updated generation new_generation = 1 req_id = 4fbb82b0-0385-44ac-acdf-f33eebf61518
642026-10-27T05:28:51.618ZINFOdns-server (http): request completed latency_us = 331 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:63185 req_id = 4fbb82b0-0385-44ac-acdf-f33eebf61518 response_code = 204 uri = /config
652026-10-27T05:28:52.157ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60806, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::a]:12038 req_id = 99ab9751-09ae-47de-b23d-eccd3915afb0
662026-10-27T05:28:52.317ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:33843
672026-10-27T05:28:52.317ZINFOdns-server (http): request completed latency_us = 251 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:33843 req_id = 2ace1f9d-fdfa-4de1-93a6-008f25dca445 response_code = 200 uri = /config
682026-10-27T05:28:53.022ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59206, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::c]:14191 req_id = fe6679f0-473c-4883-b359-7a4718966e53
692026-10-27T05:28:53.132ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:48088
702026-10-27T05:28:53.132ZINFOdns-server (http): request completed latency_us = 244 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:48088 req_id = e62e0883-0a09-4afb-80ba-e6a19269c6a1 response_code = 200 uri = /config
712026-10-27T05:28:53.547ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53105, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::b]:34316 req_id = 3351385f-6305-4624-b3b4-57136b5665d1
722026-10-27T05:28:53.673ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:59309
732026-10-27T05:28:53.673ZINFOdns-server (http): request completed latency_us = 179 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:59309 req_id = e8e73fbd-f394-4203-991c-dc0a3fd82f2b response_code = 200 uri = /config
742026-10-27T05:28:53.732ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17784, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:62266 req_id = 9c0fe773-75a5-4d29-b895-34f78a0c1e9a
752026-10-27T05:29:03.734ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36505, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:57748 req_id = b2d6ddb4-f764-4fb8-bc94-73489b5c24a4
762026-10-27T05:29:13.736ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64216, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:63146 req_id = 3f952c33-814f-4623-8e49-246c4f69b132
772026-10-27T05:29:23.737ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46717, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:53686 req_id = 57a4c476-4cda-4ee6-b8d6-779101f7bb90
782026-10-27T05:29:33.738ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64379, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:60169 req_id = f94597a6-7700-40af-ab90-bc46440d84bf
792026-10-27T05:29:43.740ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63419, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:59433 req_id = 065646f9-6ad0-4942-82c5-5dc1d15b7fc3
802026-10-27T05:29:50.421ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:43758
812026-10-27T05:29:50.425ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c5c06ed9-3b08-4e7d-94b4-878fde3c006c
822026-10-27T05:29:50.425ZINFOdns-server (store): updated generation new_generation = 1 req_id = c5c06ed9-3b08-4e7d-94b4-878fde3c006c
832026-10-27T05:29:50.425ZINFOdns-server (http): request completed latency_us = 241 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:43758 req_id = c5c06ed9-3b08-4e7d-94b4-878fde3c006c response_code = 204 uri = /config
842026-10-27T05:29:51.366ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:55297
852026-10-27T05:29:51.370ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = bb5b0887-7ee1-48ae-bf62-b1b6b9f9728e
862026-10-27T05:29:51.370ZINFOdns-server (store): updated generation new_generation = 1 req_id = bb5b0887-7ee1-48ae-bf62-b1b6b9f9728e
872026-10-27T05:29:51.370ZINFOdns-server (http): request completed latency_us = 246 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:55297 req_id = bb5b0887-7ee1-48ae-bf62-b1b6b9f9728e response_code = 204 uri = /config
882026-10-27T05:29:51.613ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:41597
892026-10-27T05:29:51.616ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 02d2cea5-d151-4ac4-82f0-b75e575c1f7b
902026-10-27T05:29:51.616ZINFOdns-server (store): updated generation new_generation = 1 req_id = 02d2cea5-d151-4ac4-82f0-b75e575c1f7b
912026-10-27T05:29:51.616ZINFOdns-server (http): request completed latency_us = 300 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:41597 req_id = 02d2cea5-d151-4ac4-82f0-b75e575c1f7b response_code = 204 uri = /config
922026-10-27T05:29:51.849ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33212, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::a]:19418 req_id = fbf45999-193e-4f5d-ae9f-7beee6fdfd5d
932026-10-27T05:29:51.965ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:32909
942026-10-27T05:29:51.966ZINFOdns-server (http): request completed latency_us = 322 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:32909 req_id = 6e97b855-eb03-494e-b120-da18d6e1309d response_code = 200 uri = /config
952026-10-27T05:29:52.361ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4253, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::b]:18196 req_id = 38881e1b-1367-4904-9478-7e62c53becdf
962026-10-27T05:29:52.440ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20184, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::c]:13607 req_id = a8b473bd-94c9-48cb-bf3a-4a9a87fd2107
972026-10-27T05:29:52.462ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:51860
982026-10-27T05:29:52.462ZINFOdns-server (http): request completed latency_us = 234 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:51860 req_id = 9a5f84ec-6309-4768-acd3-dc0cb972e97c response_code = 200 uri = /config
992026-10-27T05:29:52.543ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:61973
1002026-10-27T05:29:52.543ZINFOdns-server (http): request completed latency_us = 180 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:61973 req_id = d791422b-00c9-4dc3-8b6b-ea1143010129 response_code = 200 uri = /config
1012026-10-27T05:29:53.741ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53302, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::d]:65272 req_id = 730d9783-86b5-4b1a-8314-d8cf67f2680e
1022026-10-27T05:30:00.626ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::2]:41108 req_id = b4f97049-1e9b-4d0b-80bc-bf9e2820690a
1032026-10-27T05:30:00.626ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::2]:49894 req_id = 563ed653-7849-4531-9993-3e4bb7a6b23e
1042026-10-27T05:30:00.646ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61571, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), ), original: Query { name: Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 51, 57, 101, 48, 100, 52, 56, 45, 56, 54, 102, 48, 45, 52, 56, 101, 98, 45, 98, 102, 51, 100, 45, 99, 98, 97, 99, 50, 51, 53, 99, 57, 55, 50, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::7]:60333 req_id = 849ab58d-e06a-40eb-941f-f53101937ac1
1052026-10-27T05:30:00.647ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61571, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), ), original: Query { name: Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 51, 57, 101, 48, 100, 52, 56, 45, 56, 54, 102, 48, 45, 52, 56, 101, 98, 45, 98, 102, 51, 100, 45, 99, 98, 97, 99, 50, 51, 53, 99, 57, 55, 50, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::7]:49643 req_id = a134c654-c0d2-4522-818a-5bfefa811d1c
1062026-10-27T05:30:00.699ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), ), original: Query { name: Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 53, 53, 56, 102, 48, 99, 102, 45, 99, 98, 51, 53, 45, 52, 100, 51, 57, 45, 56, 53, 54, 50, 45, 54, 49, 100, 52, 102, 97, 51, 52, 48, 55, 102, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::6]:43473 req_id = 5f57b552-1823-4369-86ae-4df6fcfdcd3a
1072026-10-27T05:30:00.700ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), ), original: Query { name: Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 53, 53, 56, 102, 48, 99, 102, 45, 99, 98, 51, 53, 45, 52, 100, 51, 57, 45, 56, 53, 54, 50, 45, 54, 49, 100, 52, 102, 97, 51, 52, 48, 55, 102, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::6]:56079 req_id = 92d9647b-a2b8-4814-a5fe-9f3445af6ea7
1082026-10-27T05:30:00.724ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45684, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), ), original: Query { name: Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 53, 99, 54, 48, 50, 100, 102, 45, 55, 100, 52, 102, 45, 52, 99, 100, 48, 45, 57, 56, 98, 56, 45, 53, 98, 50, 97, 51, 51, 48, 101, 50, 100, 102, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::5]:34697 req_id = 362be86b-27f6-4e0a-9664-49f2e3abb990
1092026-10-27T05:30:00.725ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45684, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), ), original: Query { name: Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 53, 99, 54, 48, 50, 100, 102, 45, 55, 100, 52, 102, 45, 52, 99, 100, 48, 45, 57, 56, 98, 56, 45, 53, 98, 50, 97, 51, 51, 48, 101, 50, 100, 102, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::5]:46502 req_id = e022717c-742b-492e-89a4-0f4b36fd58f0
1102026-10-27T05:30:00.728ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), ), original: Query { name: Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 48, 51, 57, 55, 56, 100, 48, 45, 57, 97, 101, 102, 45, 52, 101, 99, 49, 45, 57, 99, 55, 99, 45, 48, 98, 54, 99, 52, 101, 100, 51, 97, 101, 102, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::4]:41971 req_id = d6ea5ad4-3cc5-493f-8c20-97e33b0cc17c
1112026-10-27T05:30:00.729ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), ), original: Query { name: Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 48, 51, 57, 55, 56, 100, 48, 45, 57, 97, 101, 102, 45, 52, 101, 99, 49, 45, 57, 99, 55, 99, 45, 48, 98, 54, 99, 52, 101, 100, 51, 97, 101, 102, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::4]:61881 req_id = cd965f41-f9ba-48ab-86e0-866f5f780bb7
1122026-10-27T05:30:00.762ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32322, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), ), original: Query { name: Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 49, 50, 97, 48, 57, 99, 99, 45, 100, 102, 48, 50, 45, 52, 52, 101, 56, 45, 98, 56, 50, 52, 45, 54, 101, 101, 51, 53, 53, 51, 54, 99, 98, 49, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::3]:61022 req_id = 7b7371c9-621e-4aeb-a976-6e6c72759f1f
1132026-10-27T05:30:00.763ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32322, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), ), original: Query { name: Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 49, 50, 97, 48, 57, 99, 99, 45, 100, 102, 48, 50, 45, 52, 52, 101, 56, 45, 98, 56, 50, 52, 45, 54, 101, 101, 51, 53, 53, 51, 54, 99, 98, 49, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::3]:41771 req_id = f9bb30aa-81a6-4c19-994b-7b4d563442bd
1142026-10-27T05:30:00.825ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47318, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::e]:38817 req_id = 8eb649d6-04e2-4b2d-84c3-ea6539bd0a25
1152026-10-27T05:30:00.826ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47318, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::e]:55610 req_id = dc7ef293-c3c6-463f-9362-e3fb163a72db
1162026-10-27T05:30:00.888ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55872, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a."), ), original: Query { name: Name("oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 48, 54, 97, 97, 56, 51, 57, 54, 45, 55, 97, 99, 97, 45, 52, 49, 52, 56, 45, 98, 97, 55, 98, 45, 54, 98, 49, 99, 102, 57, 49, 100, 54, 54, 48, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a." bind_address = [fd00:1122:3344:1::1]:53 peer_addr = [fd00:1122:3344:101::1b]:63637 req_id = 1ccec3aa-a8fb-42bb-b6b5-e199684ef4f6