Max level shown:
1 [ Oct 27 05:26:18 Enabled. ]
2 [ Oct 27 05:26:18 Rereading configuration. ]
3 [ Oct 27 05:26:19 Rereading configuration. ]
4 [ Oct 27 05:26:20 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-addresses [fd00:1122:3344:3::1]:53 &"). ]
5 [ Oct 27 05:26:20 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-10-27T05:26:20.396ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_addresses: [[fd00:1122:3344:3::1]:53] }
92026-10-27T05:26:20.396ZINFOdns-server (store): opening sled database path = /data/dns
102026-10-27T05:26:20.414ZINFOdns-server (store): pruning trees for generations newer than 0
112026-10-27T05:26:20.414ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-10-27T05:26:20.414ZINFOdns-server (dns): DNS server bound to address bind_address = [fd00:1122:3344:3::1]:53
132026-10-27T05:26:20.414ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-10-27T05:26:20.453ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6998, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:3::2]:49787 req_id = ebcf35e8-12a3-48a9-b22c-7bfc4230586b
152026-10-27T05:26:20.524ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:34890
162026-10-27T05:26:20.524ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 556a04f6-db9c-4498-9904-32e37c4072d1
172026-10-27T05:26:20.524ZINFOdns-server (store): pruning trees for generations newer than 0
182026-10-27T05:26:20.540ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
192026-10-27T05:26:20.540ZINFOdns-server (store): updated generation new_generation = 1 req_id = 556a04f6-db9c-4498-9904-32e37c4072d1
202026-10-27T05:26:20.540ZINFOdns-server (http): request completed latency_us = 15832 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:34890 req_id = 556a04f6-db9c-4498-9904-32e37c4072d1 response_code = 204 uri = /config
212026-10-27T05:26:32.596ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62700, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::1b]:54531 req_id = 306e4b41-deae-4557-9b28-e59ce5f29b1e
222026-10-27T05:26:32.601ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25982, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::1b]:52636 req_id = 360cb4de-28ff-48fc-945f-faca0b3ab7ed
232026-10-27T05:26:32.605ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23885, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::1b]:36638 req_id = 5d53fa22-0d1c-46e4-a862-b93f65c46d1b
242026-10-27T05:27:40.637ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22287, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:57315 req_id = 2272fd10-52b1-4515-a559-eba7fbc06e6f
252026-10-27T05:27:50.630ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19275, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:52307 req_id = 25ee87ee-1962-41a0-be7e-9a17f5ed17fb
262026-10-27T05:27:50.652ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52999, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::a]:60977 req_id = 7549a2c1-4e4d-4e17-88d9-6f95c98b34da
272026-10-27T05:27:51.543ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30383, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::b]:21220 req_id = 25a5629b-6c16-4b59-b94f-633534ac68e3
282026-10-27T05:27:51.863ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30388, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::c]:50970 req_id = 2ddf033c-d60d-4971-9938-c5774132ca78
292026-10-27T05:27:55.225ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46926, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::e]:59933 req_id = f46d864a-b74c-4e34-9d47-70c4d5ee935a
302026-10-27T05:27:55.225ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46926, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::e]:37608 req_id = 3282013e-c9a0-42d4-8f2f-cd0e57f87f4f
312026-10-27T05:27:57.843ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35514, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:58404 req_id = 55ad7901-8e6f-4fd5-b119-1f156321f1cb
322026-10-27T05:27:58.506ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34984, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:55137 req_id = a77431bb-a061-4f94-af31-8f049c9acd1c
332026-10-27T05:27:59.106ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 521, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:60785 req_id = 988a32a5-7448-44a1-8431-5a8f5a78a2d1
342026-10-27T05:28:01.591ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18080, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:60917 req_id = ea977938-7540-4ccc-8dbd-e241694deedc
352026-10-27T05:28:05.615ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30932, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:60465 req_id = 7d7dd662-9146-444e-b1ab-c41a5ef1542d
362026-10-27T05:28:11.838ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38891, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:65131 req_id = e9ae2c91-5358-487a-97f3-e6f6f602d31d
372026-10-27T05:28:19.117ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54994, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::1b]:52719 req_id = e7fb1ac7-9cd8-4c70-945d-df928ca6ae26
382026-10-27T05:28:19.122ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52049, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::1b]:55147 req_id = 7d2bba01-4888-410e-ae52-8f2722ebe7be
392026-10-27T05:28:19.127ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22616, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::1b]:42626 req_id = e90d5fb3-c0e7-4fdf-8d44-4e42dabbfbfa
402026-10-27T05:28:21.838ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8257, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:59637 req_id = b5e65802-7e8c-4901-b636-00ba72f74187
412026-10-27T05:28:40.592ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10286, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::c]:27161 req_id = f8d56d11-1a68-4049-beb1-96f00b2de64b
422026-10-27T05:28:40.799ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:41099
432026-10-27T05:28:40.833ZINFOdns-server (http): request completed latency_us = 17869 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:41099 req_id = d47caa16-4d4c-4aea-a15f-1d556d6ac200 response_code = 200 uri = /config
442026-10-27T05:28:50.071ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:59172
452026-10-27T05:28:50.075ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3cdd3854-05dc-4381-8a7f-1ad4a14de8a6
462026-10-27T05:28:50.076ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3cdd3854-05dc-4381-8a7f-1ad4a14de8a6
472026-10-27T05:28:50.076ZINFOdns-server (http): request completed latency_us = 2712 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:59172 req_id = 3cdd3854-05dc-4381-8a7f-1ad4a14de8a6 response_code = 204 uri = /config
482026-10-27T05:28:50.153ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24559, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::c]:47386 req_id = a3694a9c-1f8e-478e-98ee-c74f4892fff3
492026-10-27T05:28:50.283ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:47152
502026-10-27T05:28:50.284ZINFOdns-server (http): request completed latency_us = 228 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:47152 req_id = 6dbef847-bca8-4051-9961-5d1f219cfdee response_code = 200 uri = /config
512026-10-27T05:28:50.668ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:37556
522026-10-27T05:28:50.669ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b740f672-c3ed-4067-8b89-5ada99b8430e
532026-10-27T05:28:50.669ZINFOdns-server (store): updated generation new_generation = 1 req_id = b740f672-c3ed-4067-8b89-5ada99b8430e
542026-10-27T05:28:50.669ZINFOdns-server (http): request completed latency_us = 193 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:37556 req_id = b740f672-c3ed-4067-8b89-5ada99b8430e response_code = 204 uri = /config
552026-10-27T05:28:51.242ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41899, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::c]:9459 req_id = 3d59509f-0aac-4079-9a7b-01ecc1e4e9e4
562026-10-27T05:28:51.386ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:34825
572026-10-27T05:28:51.386ZINFOdns-server (http): request completed latency_us = 320 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:34825 req_id = f021d12e-462e-4772-a214-bd80f8a885d4 response_code = 200 uri = /config
582026-10-27T05:28:51.596ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:45920
592026-10-27T05:28:51.599ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 84e2d126-0ecd-4c14-a33e-ac58e7eda226
602026-10-27T05:28:51.599ZINFOdns-server (store): updated generation new_generation = 1 req_id = 84e2d126-0ecd-4c14-a33e-ac58e7eda226
612026-10-27T05:28:51.599ZINFOdns-server (http): request completed latency_us = 333 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:45920 req_id = 84e2d126-0ecd-4c14-a33e-ac58e7eda226 response_code = 204 uri = /config
622026-10-27T05:28:51.615ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:44863
632026-10-27T05:28:51.617ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 9a3e8838-631f-4eb2-9894-2a6d3ece9670
642026-10-27T05:28:51.617ZINFOdns-server (store): updated generation new_generation = 1 req_id = 9a3e8838-631f-4eb2-9894-2a6d3ece9670
652026-10-27T05:28:51.618ZINFOdns-server (http): request completed latency_us = 322 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:44863 req_id = 9a3e8838-631f-4eb2-9894-2a6d3ece9670 response_code = 204 uri = /config
662026-10-27T05:28:52.157ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28995, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::a]:51755 req_id = 7c73d128-cca9-49a3-8690-d3e9818b89bc
672026-10-27T05:28:52.317ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:60902
682026-10-27T05:28:52.317ZINFOdns-server (http): request completed latency_us = 236 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:60902 req_id = e4d8b4a0-07c3-48c0-bd5f-1f96562c5254 response_code = 200 uri = /config
692026-10-27T05:28:53.022ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6870, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::c]:55142 req_id = ce74572a-e9a6-4830-9af0-13b126dbebcc
702026-10-27T05:28:53.132ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:34965
712026-10-27T05:28:53.132ZINFOdns-server (http): request completed latency_us = 241 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:34965 req_id = b1a99ecc-42fa-4e4d-b2a7-319f10ca3454 response_code = 200 uri = /config
722026-10-27T05:28:53.547ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44668, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::b]:62409 req_id = 32fd4706-dc8a-49b2-8123-b504a7e9e8cc
732026-10-27T05:28:53.673ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:65323
742026-10-27T05:28:53.673ZINFOdns-server (http): request completed latency_us = 210 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:65323 req_id = f2865d0b-f236-479d-9982-051208c2fec1 response_code = 200 uri = /config
752026-10-27T05:28:53.732ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53889, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:54901 req_id = 181ffcff-4004-4446-8385-dfbdc76ef97b
762026-10-27T05:29:03.734ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51121, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:54327 req_id = 05c10d38-ed9c-4678-a198-d1c52d09251f
772026-10-27T05:29:13.736ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60638, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:53264 req_id = da7c58fd-68d6-4cad-a257-dc0cce2cbda6
782026-10-27T05:29:23.737ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10836, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:63178 req_id = 1a356a93-097c-4952-9cfa-e2dc0e7e9e44
792026-10-27T05:29:33.738ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33861, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:64416 req_id = 22d9a2c7-5d0f-4ecf-9216-8d6b517e72b0
802026-10-27T05:29:43.740ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41952, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:55527 req_id = 3c503b35-c3c5-42dd-99b9-da0aff43b47a
812026-10-27T05:29:50.423ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:60669
822026-10-27T05:29:50.425ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 40e50312-7579-4f57-a589-8ba6025d5dfa
832026-10-27T05:29:50.425ZINFOdns-server (store): updated generation new_generation = 1 req_id = 40e50312-7579-4f57-a589-8ba6025d5dfa
842026-10-27T05:29:50.425ZINFOdns-server (http): request completed latency_us = 301 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:60669 req_id = 40e50312-7579-4f57-a589-8ba6025d5dfa response_code = 204 uri = /config
852026-10-27T05:29:51.367ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:64994
862026-10-27T05:29:51.370ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 739d02b3-5e55-4ca8-8a95-abf248a1ce7e
872026-10-27T05:29:51.370ZINFOdns-server (store): updated generation new_generation = 1 req_id = 739d02b3-5e55-4ca8-8a95-abf248a1ce7e
882026-10-27T05:29:51.370ZINFOdns-server (http): request completed latency_us = 210 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:64994 req_id = 739d02b3-5e55-4ca8-8a95-abf248a1ce7e response_code = 204 uri = /config
892026-10-27T05:29:51.614ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:63648
902026-10-27T05:29:51.616ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 5795c553-b389-4a01-af4a-d73339647343
912026-10-27T05:29:51.616ZINFOdns-server (store): updated generation new_generation = 1 req_id = 5795c553-b389-4a01-af4a-d73339647343
922026-10-27T05:29:51.616ZINFOdns-server (http): request completed latency_us = 257 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:63648 req_id = 5795c553-b389-4a01-af4a-d73339647343 response_code = 204 uri = /config
932026-10-27T05:29:51.849ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16695, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::a]:2311 req_id = 84ebed18-a2c8-4cf6-a955-5678afbd6fea
942026-10-27T05:29:51.965ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:36562
952026-10-27T05:29:51.966ZINFOdns-server (http): request completed latency_us = 302 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:36562 req_id = 0038f8cc-5d45-45ae-ae7c-42ddd42a515c response_code = 200 uri = /config
962026-10-27T05:29:52.360ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53894, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::b]:58893 req_id = bd16e883-890e-4385-bc2f-0bd0bd44944e
972026-10-27T05:29:52.440ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5068, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::c]:43828 req_id = f441af8a-34c2-4224-9506-e24106e80b08
982026-10-27T05:29:52.462ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:59011
992026-10-27T05:29:52.462ZINFOdns-server (http): request completed latency_us = 235 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:59011 req_id = 2fa815bb-8d14-4101-a4f2-82d2e890a9ce response_code = 200 uri = /config
1002026-10-27T05:29:52.543ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:36636
1012026-10-27T05:29:52.543ZINFOdns-server (http): request completed latency_us = 180 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:36636 req_id = 3367f14f-5fa2-43ab-840a-e3d9182d07d0 response_code = 200 uri = /config
1022026-10-27T05:29:53.741ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32470, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::d]:49264 req_id = 7fe28f8b-66ff-4488-8f67-3fcabea49b14
1032026-10-27T05:30:00.626ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::2]:33426 req_id = 937105f6-fb69-401f-807f-d1ddd3cd0927
1042026-10-27T05:30:00.627ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::2]:60095 req_id = a1a1b6ab-754a-42a5-94ab-7dd71e090bfd
1052026-10-27T05:30:00.647ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61571, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), ), original: Query { name: Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 51, 57, 101, 48, 100, 52, 56, 45, 56, 54, 102, 48, 45, 52, 56, 101, 98, 45, 98, 102, 51, 100, 45, 99, 98, 97, 99, 50, 51, 53, 99, 57, 55, 50, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::7]:56597 req_id = a5063929-4b18-4249-8c67-5e679d6c9d8c
1062026-10-27T05:30:00.647ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61571, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), ), original: Query { name: Name("oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 51, 57, 101, 48, 100, 52, 56, 45, 56, 54, 102, 48, 45, 52, 56, 101, 98, 45, 98, 102, 51, 100, 45, 99, 98, 97, 99, 50, 51, 53, 99, 57, 55, 50, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_039e0d48-86f0-48eb-bf3d-cbac235c9722." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::7]:60033 req_id = 68fac85c-9158-4f75-855d-5efb175d2cca
1072026-10-27T05:30:00.699ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), ), original: Query { name: Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 53, 53, 56, 102, 48, 99, 102, 45, 99, 98, 51, 53, 45, 52, 100, 51, 57, 45, 56, 53, 54, 50, 45, 54, 49, 100, 52, 102, 97, 51, 52, 48, 55, 102, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::6]:61673 req_id = 9874c493-2c49-4bee-9efc-78fdf106a586
1082026-10-27T05:30:00.700ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), ), original: Query { name: Name("oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 53, 53, 56, 102, 48, 99, 102, 45, 99, 98, 51, 53, 45, 52, 100, 51, 57, 45, 56, 53, 54, 50, 45, 54, 49, 100, 52, 102, 97, 51, 52, 48, 55, 102, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2558f0cf-cb35-4d39-8562-61d4fa3407f7." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::6]:45918 req_id = c90fd30b-0ff4-4e34-932f-391c70c1fcbb
1092026-10-27T05:30:00.725ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45684, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), ), original: Query { name: Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 53, 99, 54, 48, 50, 100, 102, 45, 55, 100, 52, 102, 45, 52, 99, 100, 48, 45, 57, 56, 98, 56, 45, 53, 98, 50, 97, 51, 51, 48, 101, 50, 100, 102, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::5]:32908 req_id = 63586f9d-5bea-4817-9264-966e86fa4e84
1102026-10-27T05:30:00.725ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45684, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), ), original: Query { name: Name("oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 53, 99, 54, 48, 50, 100, 102, 45, 55, 100, 52, 102, 45, 52, 99, 100, 48, 45, 57, 56, 98, 56, 45, 53, 98, 50, 97, 51, 51, 48, 101, 50, 100, 102, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c5c602df-7d4f-4cd0-98b8-5b2a330e2df4." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::5]:56902 req_id = b3cac5f5-cd7f-4f19-a53a-461969ff6014
1112026-10-27T05:30:00.729ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), ), original: Query { name: Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 48, 51, 57, 55, 56, 100, 48, 45, 57, 97, 101, 102, 45, 52, 101, 99, 49, 45, 57, 99, 55, 99, 45, 48, 98, 54, 99, 52, 101, 100, 51, 97, 101, 102, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::4]:48172 req_id = e75ef0b3-ba36-4a7f-9225-b9036a331bf6
1122026-10-27T05:30:00.729ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 503, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), ), original: Query { name: Name("oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 48, 51, 57, 55, 56, 100, 48, 45, 57, 97, 101, 102, 45, 52, 101, 99, 49, 45, 57, 99, 55, 99, 45, 48, 98, 54, 99, 52, 101, 100, 51, 97, 101, 102, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_403978d0-9aef-4ec1-9c7c-0b6c4ed3aef8." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::4]:60755 req_id = a5069595-d5ac-49cd-9588-e68946ec5fcf
1132026-10-27T05:30:00.763ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32322, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), ), original: Query { name: Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 49, 50, 97, 48, 57, 99, 99, 45, 100, 102, 48, 50, 45, 52, 52, 101, 56, 45, 98, 56, 50, 52, 45, 54, 101, 101, 51, 53, 53, 51, 54, 99, 98, 49, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::3]:52842 req_id = 741217a0-9b1a-4b18-abde-0c2af94e4945
1142026-10-27T05:30:00.764ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32322, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), ), original: Query { name: Name("oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 49, 50, 97, 48, 57, 99, 99, 45, 100, 102, 48, 50, 45, 52, 52, 101, 56, 45, 98, 56, 50, 52, 45, 54, 101, 101, 51, 53, 53, 51, 54, 99, 98, 49, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f12a09cc-df02-44e8-b824-6ee35536cb1f." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::3]:41545 req_id = 5bba8080-74c9-4c1d-8ba5-31995b3c875f
1152026-10-27T05:30:00.826ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47318, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::e]:65336 req_id = 0d068002-9582-4b3f-ab1a-5cdc595daccf
1162026-10-27T05:30:00.827ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47318, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), ), original: Query { name: Name("oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 57, 101, 97, 56, 48, 51, 50, 45, 100, 52, 101, 52, 45, 52, 49, 97, 101, 45, 97, 52, 99, 48, 45, 101, 98, 98, 98, 99, 50, 99, 101, 55, 102, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_69ea8032-d4e4-41ae-a4c0-ebbbc2ce7f77." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::e]:45804 req_id = 30dc43b3-2ae0-4c9f-b4ea-cf3b394ca374
1172026-10-27T05:30:00.888ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55872, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a."), ), original: Query { name: Name("oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 48, 54, 97, 97, 56, 51, 57, 54, 45, 55, 97, 99, 97, 45, 52, 49, 52, 56, 45, 98, 97, 55, 98, 45, 54, 98, 49, 99, 102, 57, 49, 100, 54, 54, 48, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_06aa8396-7aca-4148-ba7b-6b1cf91d660a." bind_address = [fd00:1122:3344:3::1]:53 peer_addr = [fd00:1122:3344:101::1b]:38042 req_id = b8232e02-683d-472c-8ee5-cad7a3798393