Max level shown:
1 [ Oct 27 05:26:18 Enabled. ]
2 [ Oct 27 05:26:18 Rereading configuration. ]
3 [ Oct 27 05:26:19 Rereading configuration. ]
4 [ Oct 27 05:26:20 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-addresses [fd00:1122:3344:2::1]:53 &"). ]
5 [ Oct 27 05:26:20 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-10-27T05:26:20.477ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_addresses: [[fd00:1122:3344:2::1]:53] }
92026-10-27T05:26:20.477ZINFOdns-server (store): opening sled database path = /data/dns
102026-10-27T05:26:20.498ZINFOdns-server (store): pruning trees for generations newer than 0
112026-10-27T05:26:20.498ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-10-27T05:26:20.498ZINFOdns-server (dns): DNS server bound to address bind_address = [fd00:1122:3344:2::1]:53
132026-10-27T05:26:20.498ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-10-27T05:26:20.541ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:59328
152026-10-27T05:26:20.541ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 7b496281-c171-4207-81b2-193da972718c
162026-10-27T05:26:20.541ZINFOdns-server (store): pruning trees for generations newer than 0
172026-10-27T05:26:20.557ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-10-27T05:26:20.557ZINFOdns-server (store): updated generation new_generation = 1 req_id = 7b496281-c171-4207-81b2-193da972718c
192026-10-27T05:26:20.557ZINFOdns-server (http): request completed latency_us = 15806 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:59328 req_id = 7b496281-c171-4207-81b2-193da972718c response_code = 204 uri = /config
202026-10-27T05:26:32.596ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62700, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::1b]:64309 req_id = 248f8745-0e0e-4527-a23b-7cc41ccafcdf
212026-10-27T05:26:32.601ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25982, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::1b]:55992 req_id = 8107087a-3834-4b01-a000-f9aec38e7cb5
222026-10-27T05:26:32.605ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23885, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::1b]:39581 req_id = a6fe9ec8-9d4f-406e-a113-09657c5cd013
232026-10-27T05:27:40.640ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18058, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:58943 req_id = b339f97b-2ce9-48ae-bf10-44f15c3ef35e
242026-10-27T05:27:50.631ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27968, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:64979 req_id = f68b0453-0dd6-4caa-8166-0e85989f38fb
252026-10-27T05:27:50.652ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7170, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::a]:58061 req_id = 7655a05b-f437-4125-b710-abf336697ec0
262026-10-27T05:27:51.543ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19350, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::b]:28760 req_id = da6b99a9-4cea-4aa2-9406-9cd23208c452
272026-10-27T05:27:51.863ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55410, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::c]:9012 req_id = 4dbbc220-1165-44ad-944a-f7cf5c9dedf2
282026-10-27T05:27:55.212ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46926, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::e]:32783 req_id = 40388ff5-6529-4dca-8ee3-41ae0a1acd86
292026-10-27T05:27:55.225ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46926, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::e]:52145 req_id = 3cd81ee1-5032-4763-bf9f-4a6dc134b9e0
302026-10-27T05:27:57.843ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37905, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:57661 req_id = 7a45375a-0485-4781-9dbd-595084ed511e
312026-10-27T05:27:58.506ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23160, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:52200 req_id = de6dcee2-ce1d-4276-89e1-69e6befd7288
322026-10-27T05:27:59.106ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22821, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:61403 req_id = 684f5c7a-4e6d-4d1d-b9f0-17fb232717b0
332026-10-27T05:28:01.591ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55218, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:59542 req_id = 9cdd745e-b058-4e4b-ab8c-e0cde4bad543
342026-10-27T05:28:05.615ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21397, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:51707 req_id = 03ea8103-cce5-41f7-aca3-f13ff765e7c8
352026-10-27T05:28:11.838ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34613, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:55018 req_id = 054b0088-071d-4821-b058-0587121e1109
362026-10-27T05:28:19.117ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54994, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::1b]:65348 req_id = f2e6d996-6b44-4a9a-9c71-ec0901493140
372026-10-27T05:28:19.122ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52049, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::1b]:47702 req_id = 0a557059-b083-4a0b-b1b1-7da57006d5a7
382026-10-27T05:28:19.127ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22616, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::1b]:36078 req_id = 081e8e45-15a9-4225-a9cd-a56ecb322566
392026-10-27T05:28:21.838ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20084, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:65128 req_id = 731408bd-eb3f-48e0-804a-7e1decc39d1f
402026-10-27T05:28:40.592ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32777, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::c]:39671 req_id = ffa8b7c4-b45a-4a42-b897-04e40fdcea05
412026-10-27T05:28:40.804ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:50447
422026-10-27T05:28:40.840ZINFOdns-server (http): request completed latency_us = 20330 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:50447 req_id = 5f94b496-f944-4b28-883e-e1277b00f2cb response_code = 200 uri = /config
432026-10-27T05:28:50.073ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:57432
442026-10-27T05:28:50.073ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 30839745-e0ef-42a5-b5da-ef68a327fbd5
452026-10-27T05:28:50.073ZINFOdns-server (store): updated generation new_generation = 1 req_id = 30839745-e0ef-42a5-b5da-ef68a327fbd5
462026-10-27T05:28:50.073ZINFOdns-server (http): request completed latency_us = 320 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:57432 req_id = 30839745-e0ef-42a5-b5da-ef68a327fbd5 response_code = 204 uri = /config
472026-10-27T05:28:50.153ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19447, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::c]:50238 req_id = ff5472d8-a9af-4712-b68a-8a75dbd7b2f4
482026-10-27T05:28:50.283ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:50751
492026-10-27T05:28:50.284ZINFOdns-server (http): request completed latency_us = 259 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:50751 req_id = 7d7150c1-3764-40fd-9383-d0845ea06b4d response_code = 200 uri = /config
502026-10-27T05:28:50.669ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:56894
512026-10-27T05:28:50.669ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 8f4441ef-d5f3-4929-880f-c2415f8e44fe
522026-10-27T05:28:50.669ZINFOdns-server (store): updated generation new_generation = 1 req_id = 8f4441ef-d5f3-4929-880f-c2415f8e44fe
532026-10-27T05:28:50.669ZINFOdns-server (http): request completed latency_us = 192 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:56894 req_id = 8f4441ef-d5f3-4929-880f-c2415f8e44fe response_code = 204 uri = /config
542026-10-27T05:28:51.242ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52296, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::c]:50631 req_id = f3e85161-2ea8-4c48-b792-2e56948365b1
552026-10-27T05:28:51.386ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:41624
562026-10-27T05:28:51.386ZINFOdns-server (http): request completed latency_us = 330 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:41624 req_id = 8fdad50f-ba7d-469c-b943-b1846814775c response_code = 200 uri = /config
572026-10-27T05:28:51.598ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:33718
582026-10-27T05:28:51.599ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 024683a2-4a58-4c99-874d-313f03da2dc5
592026-10-27T05:28:51.599ZINFOdns-server (store): updated generation new_generation = 1 req_id = 024683a2-4a58-4c99-874d-313f03da2dc5
602026-10-27T05:28:51.599ZINFOdns-server (http): request completed latency_us = 334 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:33718 req_id = 024683a2-4a58-4c99-874d-313f03da2dc5 response_code = 204 uri = /config
612026-10-27T05:28:51.617ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:63432
622026-10-27T05:28:51.617ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 08681cf8-0ed2-41f4-b53b-e97436cdd989
632026-10-27T05:28:51.617ZINFOdns-server (store): updated generation new_generation = 1 req_id = 08681cf8-0ed2-41f4-b53b-e97436cdd989
642026-10-27T05:28:51.618ZINFOdns-server (http): request completed latency_us = 410 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:63432 req_id = 08681cf8-0ed2-41f4-b53b-e97436cdd989 response_code = 204 uri = /config
652026-10-27T05:28:52.157ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41535, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::a]:56456 req_id = 45e49a1f-519f-4887-96d8-3f3e1c9eb416
662026-10-27T05:28:52.317ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:35122
672026-10-27T05:28:52.317ZINFOdns-server (http): request completed latency_us = 207 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:35122 req_id = 25a6f6a3-777d-45a0-aa06-59ea19f67f84 response_code = 200 uri = /config
682026-10-27T05:28:53.022ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31847, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::c]:51055 req_id = 2e338408-47eb-47d3-800e-cd50cd9a5c51
692026-10-27T05:28:53.132ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:57521
702026-10-27T05:28:53.132ZINFOdns-server (http): request completed latency_us = 188 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:57521 req_id = c32a5a22-d34c-4c38-9c75-5ec2ea459591 response_code = 200 uri = /config
712026-10-27T05:28:53.547ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57139, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::b]:34747 req_id = 09cf24e4-6b2f-48c8-a286-5a2d90eb6dee
722026-10-27T05:28:53.673ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:45594
732026-10-27T05:28:53.673ZINFOdns-server (http): request completed latency_us = 194 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:45594 req_id = 240d7374-ef97-465e-880f-0663103230db response_code = 200 uri = /config
742026-10-27T05:28:53.732ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47037, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:51507 req_id = af9d335c-7e22-4207-810c-e3aaf8d00715
752026-10-27T05:29:03.734ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59342, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:61949 req_id = b8cf4687-25fc-4825-aad2-f0daa4d251f1
762026-10-27T05:29:13.736ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49790, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:59381 req_id = e7ac7e5e-c227-4e03-bb7a-a3c50a3b9308
772026-10-27T05:29:23.737ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16916, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:49974 req_id = d1aed303-3081-4652-b4ed-c6fc84920be2
782026-10-27T05:29:33.738ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12637, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:51050 req_id = c154c0bc-ab4c-4eb6-8b28-546ff85e008b
792026-10-27T05:29:43.739ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56091, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:52811 req_id = 76460d98-44c4-4d47-b2dd-664ab50c0305
802026-10-27T05:29:50.424ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:62997
812026-10-27T05:29:50.425ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 29f646c6-8132-439b-a691-19e7c044b0ea
822026-10-27T05:29:50.425ZINFOdns-server (store): updated generation new_generation = 1 req_id = 29f646c6-8132-439b-a691-19e7c044b0ea
832026-10-27T05:29:50.425ZINFOdns-server (http): request completed latency_us = 238 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:62997 req_id = 29f646c6-8132-439b-a691-19e7c044b0ea response_code = 204 uri = /config
842026-10-27T05:29:51.369ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:39899
852026-10-27T05:29:51.370ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c1b1df1f-6fcd-4057-b82c-0a012c7b2227
862026-10-27T05:29:51.370ZINFOdns-server (store): updated generation new_generation = 1 req_id = c1b1df1f-6fcd-4057-b82c-0a012c7b2227
872026-10-27T05:29:51.370ZINFOdns-server (http): request completed latency_us = 329 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:39899 req_id = c1b1df1f-6fcd-4057-b82c-0a012c7b2227 response_code = 204 uri = /config
882026-10-27T05:29:51.616ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:41847
892026-10-27T05:29:51.616ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = f52726f7-d401-4cdc-9cca-16e4750dcc04
902026-10-27T05:29:51.616ZINFOdns-server (store): updated generation new_generation = 1 req_id = f52726f7-d401-4cdc-9cca-16e4750dcc04
912026-10-27T05:29:51.616ZINFOdns-server (http): request completed latency_us = 215 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:41847 req_id = f52726f7-d401-4cdc-9cca-16e4750dcc04 response_code = 204 uri = /config
922026-10-27T05:29:51.849ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57015, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::a]:43518 req_id = 8247a47f-6d9a-4ee3-83f2-8bc61b2b9205
932026-10-27T05:29:51.965ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:63394
942026-10-27T05:29:51.966ZINFOdns-server (http): request completed latency_us = 244 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:63394 req_id = c5c9a7fd-f71a-44f9-9b5f-e9743f48e29a response_code = 200 uri = /config
952026-10-27T05:29:52.360ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50997, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::b]:51880 req_id = 739e5ffd-18e7-4e80-8ce3-28f58ca3ef6a
962026-10-27T05:29:52.440ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57769, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::c]:41676 req_id = 3c9b3f43-5298-4982-9c07-6f5e92667ee2
972026-10-27T05:29:52.462ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:50046
982026-10-27T05:29:52.462ZINFOdns-server (http): request completed latency_us = 190 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:50046 req_id = 20a9a2ff-7144-45a3-9817-da6ece6d3b20 response_code = 200 uri = /config
992026-10-27T05:29:52.543ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:61291
1002026-10-27T05:29:52.543ZINFOdns-server (http): request completed latency_us = 178 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:61291 req_id = d75e5e77-ae1c-4182-95c0-3f5f75d2a88a response_code = 200 uri = /config
1012026-10-27T05:29:53.741ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 617, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::d]:52979 req_id = 767a607d-5635-4557-bdae-dc51b8ade95b
1022026-10-27T05:30:00.626ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::2]:65092 req_id = cf910b22-080d-494c-ab1c-1f44bc092777
1032026-10-27T05:30:00.627ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::2]:51225 req_id = 133d4037-bc1d-4d34-b37b-ff549bb82761
1042026-10-27T05:30:00.646ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61571, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), ), original: Query { name: Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 51, 57, 101, 48, 100, 52, 56, 45, 56, 54, 102, 48, 45, 52, 56, 101, 98, 45, 98, 102, 51, 100, 45, 99, 98, 97, 99, 50, 51, 53, 99, 57, 55, 50, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::7]:41265 req_id = 93f1371f-4f93-40e6-8586-ba9f709dda06
1052026-10-27T05:30:00.647ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61571, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), ), original: Query { name: Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 51, 57, 101, 48, 100, 52, 56, 45, 56, 54, 102, 48, 45, 52, 56, 101, 98, 45, 98, 102, 51, 100, 45, 99, 98, 97, 99, 50, 51, 53, 99, 57, 55, 50, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::7]:41206 req_id = d2052dc7-fe8f-4cb1-beb8-a673bfa7cf03
1062026-10-27T05:30:00.699ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), ), original: Query { name: Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 53, 53, 56, 102, 48, 99, 102, 45, 99, 98, 51, 53, 45, 52, 100, 51, 57, 45, 56, 53, 54, 50, 45, 54, 49, 100, 52, 102, 97, 51, 52, 48, 55, 102, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::6]:36754 req_id = 2e44a90c-7e82-4e61-892a-07a8fac15218
1072026-10-27T05:30:00.700ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), ), original: Query { name: Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 53, 53, 56, 102, 48, 99, 102, 45, 99, 98, 51, 53, 45, 52, 100, 51, 57, 45, 56, 53, 54, 50, 45, 54, 49, 100, 52, 102, 97, 51, 52, 48, 55, 102, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::6]:60313 req_id = 2f466e44-c489-4165-8a98-707de4c54148
1082026-10-27T05:30:00.725ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45684, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), ), original: Query { name: Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 53, 99, 54, 48, 50, 100, 102, 45, 55, 100, 52, 102, 45, 52, 99, 100, 48, 45, 57, 56, 98, 56, 45, 53, 98, 50, 97, 51, 51, 48, 101, 50, 100, 102, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::5]:49637 req_id = b85b5b80-45a4-44e9-9734-6e20b0172206
1092026-10-27T05:30:00.725ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45684, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), ), original: Query { name: Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 53, 99, 54, 48, 50, 100, 102, 45, 55, 100, 52, 102, 45, 52, 99, 100, 48, 45, 57, 56, 98, 56, 45, 53, 98, 50, 97, 51, 51, 48, 101, 50, 100, 102, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::5]:47824 req_id = 9f67d623-47bd-46fd-b782-d88c1d805276
1102026-10-27T05:30:00.728ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), ), original: Query { name: Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 48, 51, 57, 55, 56, 100, 48, 45, 57, 97, 101, 102, 45, 52, 101, 99, 49, 45, 57, 99, 55, 99, 45, 48, 98, 54, 99, 52, 101, 100, 51, 97, 101, 102, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::4]:33845 req_id = 36c0b31e-ec7d-455f-bf09-f41a51c200b6
1112026-10-27T05:30:00.729ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), ), original: Query { name: Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 48, 51, 57, 55, 56, 100, 48, 45, 57, 97, 101, 102, 45, 52, 101, 99, 49, 45, 57, 99, 55, 99, 45, 48, 98, 54, 99, 52, 101, 100, 51, 97, 101, 102, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::4]:51284 req_id = db3695e0-d77b-409d-8a83-9aab92c64f65
1122026-10-27T05:30:00.763ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32322, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), ), original: Query { name: Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 49, 50, 97, 48, 57, 99, 99, 45, 100, 102, 48, 50, 45, 52, 52, 101, 56, 45, 98, 56, 50, 52, 45, 54, 101, 101, 51, 53, 53, 51, 54, 99, 98, 49, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::3]:35554 req_id = 98d7add1-e5aa-45ce-a3a0-cd548657736a
1132026-10-27T05:30:00.764ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32322, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), ), original: Query { name: Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 49, 50, 97, 48, 57, 99, 99, 45, 100, 102, 48, 50, 45, 52, 52, 101, 56, 45, 98, 56, 50, 52, 45, 54, 101, 101, 51, 53, 53, 51, 54, 99, 98, 49, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::3]:61568 req_id = 5f0892e3-5894-4904-b6fa-c8f9c0e6cb94
1142026-10-27T05:30:00.826ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47318, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::e]:34164 req_id = 6ed53e4d-d741-4040-9f3e-81c77a8e9ca6
1152026-10-27T05:30:00.826ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47318, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::e]:35041 req_id = 3fd30906-799f-43ad-8565-5e506bddbcdd
1162026-10-27T05:30:00.888ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55872, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a."), ), original: Query { name: Name("oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 48, 54, 97, 97, 56, 51, 57, 54, 45, 55, 97, 99, 97, 45, 52, 49, 52, 56, 45, 98, 97, 55, 98, 45, 54, 98, 49, 99, 102, 57, 49, 100, 54, 54, 48, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a." bind_address = [fd00:1122:3344:2::1]:53 peer_addr = [fd00:1122:3344:101::1b]:44086 req_id = 1dc969b3-c2f4-4d4c-aa58-40b19574fee6