Max level shown:
1 [ Sep 3 02:11:48 Enabled. ]
2 [ Sep 3 02:11:48 Rereading configuration. ]
3 [ Sep 3 02:11:48 Rereading configuration. ]
4 [ Sep 3 02:11:50 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Sep 3 02:11:50 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-09-03T02:11:50.142ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-09-03T02:11:50.142ZINFOdns-server (store): opening sled database path = /data/dns
102026-09-03T02:11:50.160ZINFOdns-server (store): pruning trees for generations newer than 0
112026-09-03T02:11:50.160ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-09-03T02:11:50.160ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-09-03T02:11:50.160ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-09-03T02:11:50.201ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:44410
152026-09-03T02:11:50.202ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 6c7061f4-b58e-41b3-b1a5-bbaabe02327a
162026-09-03T02:11:50.202ZINFOdns-server (store): pruning trees for generations newer than 0
172026-09-03T02:11:50.220ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-09-03T02:11:50.220ZINFOdns-server (store): updated generation new_generation = 1 req_id = 6c7061f4-b58e-41b3-b1a5-bbaabe02327a
192026-09-03T02:11:50.220ZINFOdns-server (http): request completed latency_us = 18113 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:44410 req_id = 6c7061f4-b58e-41b3-b1a5-bbaabe02327a response_code = 204 uri = /config
202026-09-03T02:12:02.630ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12154, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:64358 req_id = ae5e9509-898b-4520-8d4f-be37faff41e1
212026-09-03T02:12:02.634ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43943, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59595 req_id = 9e5f9771-4f69-4d2c-b324-5af128f36e50
222026-09-03T02:12:02.638ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44764, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:45552 req_id = 5d13c3f6-3f8e-48ee-aa0e-f62edea9f8f6
232026-09-03T02:13:00.341ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52041, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55358 req_id = 0b18c6d8-9e30-4bfb-97dd-865dd4abdfbe
242026-09-03T02:13:06.411ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47822, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), ), original: Query { name: Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 97, 57, 97, 51, 57, 53, 101, 49, 45, 52, 55, 54, 57, 45, 52, 54, 52, 53, 45, 98, 98, 102, 51, 45, 54, 55, 54, 97, 57, 53, 97, 57, 56, 53, 56, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581." peer_addr = [fd00:1122:3344:101::e]:64675 req_id = 92fe496c-e8be-4fc1-a6de-9402602af5c7
252026-09-03T02:13:06.412ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47822, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), ), original: Query { name: Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 97, 57, 97, 51, 57, 53, 101, 49, 45, 52, 55, 54, 57, 45, 52, 54, 52, 53, 45, 98, 98, 102, 51, 45, 54, 55, 54, 97, 57, 53, 97, 57, 56, 53, 56, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581." peer_addr = [fd00:1122:3344:101::e]:48078 req_id = 760eb23a-fcb2-447a-a59d-bf61e5e72c26
262026-09-03T02:13:10.199ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14613, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:19417 req_id = 6676e971-1a08-4837-849e-e954fb758e4f
272026-09-03T02:13:10.226ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5639, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:17082 req_id = 569d9414-b012-4ac3-8d95-bb742f33c071
282026-09-03T02:13:11.234ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:50621
292026-09-03T02:13:11.235ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:61522
302026-09-03T02:13:11.238ZINFOdns-server (http): request completed latency_us = 3669 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:50621 req_id = c7e3d44f-a714-498d-8ad5-d8b1a1fd1e9f response_code = 200 uri = /config
312026-09-03T02:13:11.238ZINFOdns-server (http): request completed latency_us = 3669 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:61522 req_id = 0df5cc35-43b7-48a9-8bd7-46f0c8236154 response_code = 200 uri = /config
322026-09-03T02:13:11.840ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33134, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:56608 req_id = 798c3d18-69eb-4440-9860-8132194efb29
332026-09-03T02:13:11.845ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22736, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:26624 req_id = bead754b-6f56-45ee-8ada-40b99c325bb1
342026-09-03T02:13:12.260ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:45505
352026-09-03T02:13:12.261ZINFOdns-server (http): request completed latency_us = 207 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:45505 req_id = f236e38e-89e8-4e5a-b2b7-bad2087b044f response_code = 200 uri = /config
362026-09-03T02:13:12.329ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:44403
372026-09-03T02:13:12.329ZINFOdns-server (http): request completed latency_us = 207 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:44403 req_id = f11b0ec3-edf7-40e4-81d1-76e38cbdfa4f response_code = 200 uri = /config
382026-09-03T02:13:13.477ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63018, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:8072 req_id = cfd4dbb4-52e7-4246-a645-f036cb7687b5
392026-09-03T02:13:13.477ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:60224
402026-09-03T02:13:13.478ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 7dd4cc22-a196-4381-8d8f-bab30b338ab1
412026-09-03T02:13:13.478ZINFOdns-server (store): updated generation new_generation = 1 req_id = 7dd4cc22-a196-4381-8d8f-bab30b338ab1
422026-09-03T02:13:13.478ZINFOdns-server (http): request completed latency_us = 336 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:60224 req_id = 7dd4cc22-a196-4381-8d8f-bab30b338ab1 response_code = 204 uri = /config
432026-09-03T02:13:13.736ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:63014
442026-09-03T02:13:13.737ZINFOdns-server (http): request completed latency_us = 260 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:63014 req_id = e5a75e3c-8ced-46a0-9b90-13281672c8e8 response_code = 200 uri = /config
452026-09-03T02:13:14.640ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38792, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:26902 req_id = f5b1481a-a177-4108-b5f8-fbc97973bdcc
462026-09-03T02:13:14.765ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:62433
472026-09-03T02:13:14.765ZINFOdns-server (http): request completed latency_us = 179 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:62433 req_id = 90e82620-05b6-4646-93bd-0baa3dffac06 response_code = 200 uri = /config
482026-09-03T02:13:20.338ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52226, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:49793 req_id = f890aee8-a7b0-4849-9e8b-36f3576871ba
492026-09-03T02:13:20.916ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30296, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:41996 req_id = 5e75751c-41b4-4335-bc6a-d75d5fa0927f
502026-09-03T02:13:21.030ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:43364
512026-09-03T02:13:21.031ZINFOdns-server (http): request completed latency_us = 179 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:43364 req_id = 079c1309-d65a-454e-9d22-ac607f699d6f response_code = 200 uri = /config
522026-09-03T02:13:22.197ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45501, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:36678 req_id = a5acbe64-f311-45f6-a7aa-0581895a96a2
532026-09-03T02:13:22.312ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:48506
542026-09-03T02:13:22.312ZINFOdns-server (http): request completed latency_us = 215 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:48506 req_id = e845f25e-a0da-420c-bd0c-51414f923803 response_code = 200 uri = /config
552026-09-03T02:13:30.339ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18972, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:62579 req_id = ac16262e-6a37-4482-b313-b16332868be3
562026-09-03T02:13:40.341ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52891, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:65502 req_id = d8fbee80-7ee8-4de0-90fd-abe68caef926
572026-09-03T02:13:50.344ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1616, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59723 req_id = d149dedb-c04e-4dbe-b77b-f6136c2fdba7
582026-09-03T02:14:00.345ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32635, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55862 req_id = 62ab9aef-37a2-460e-8df9-924f872f3b14
592026-09-03T02:14:02.814ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62099, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:37206 req_id = 8c143278-2004-492b-be24-8240cdf1a82a
602026-09-03T02:14:02.819ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33106, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:39221 req_id = 54e7988c-81b9-4704-a76f-97816b3c89ec
612026-09-03T02:14:02.824ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1451, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:65371 req_id = 404f81e8-a992-414f-ad8e-335adeb4d784
622026-09-03T02:14:09.985ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:40673
632026-09-03T02:14:09.986ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 8a4831a4-6e2e-45ec-be3d-fe231297da86
642026-09-03T02:14:09.986ZINFOdns-server (store): updated generation new_generation = 1 req_id = 8a4831a4-6e2e-45ec-be3d-fe231297da86
652026-09-03T02:14:09.986ZINFOdns-server (http): request completed latency_us = 630 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:40673 req_id = 8a4831a4-6e2e-45ec-be3d-fe231297da86 response_code = 204 uri = /config
662026-09-03T02:14:10.161ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:50317
672026-09-03T02:14:10.161ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c2f5f7cf-7f45-43c9-8023-592d77ac8627
682026-09-03T02:14:10.161ZINFOdns-server (store): updated generation new_generation = 1 req_id = c2f5f7cf-7f45-43c9-8023-592d77ac8627
692026-09-03T02:14:10.161ZINFOdns-server (http): request completed latency_us = 270 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:50317 req_id = c2f5f7cf-7f45-43c9-8023-592d77ac8627 response_code = 204 uri = /config
702026-09-03T02:14:10.344ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29773, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:51546 req_id = b577e24b-2f6f-4896-8d10-f965b89ce439
712026-09-03T02:14:10.830ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1273, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:36586 req_id = 92799b1d-9291-444a-b5dd-88e63775896d
722026-09-03T02:14:10.932ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37616
732026-09-03T02:14:10.932ZINFOdns-server (http): request completed latency_us = 176 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:37616 req_id = 187a3ced-1533-4843-82e5-10985b110bae response_code = 200 uri = /config
742026-09-03T02:14:11.317ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27465, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:15577 req_id = 15631e6b-da5e-44a5-8a87-7772c77f9225
752026-09-03T02:14:11.438ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:41967
762026-09-03T02:14:11.438ZINFOdns-server (http): request completed latency_us = 308 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:41967 req_id = 58f4eddb-aaf9-4dca-89c3-47ae2258c3ce response_code = 200 uri = /config
772026-09-03T02:14:11.488ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:41482
782026-09-03T02:14:11.488ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a6abd96e-4f7b-46a3-89ec-ac41a53f1120
792026-09-03T02:14:11.489ZINFOdns-server (store): updated generation new_generation = 1 req_id = a6abd96e-4f7b-46a3-89ec-ac41a53f1120
802026-09-03T02:14:11.489ZINFOdns-server (http): request completed latency_us = 297 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:41482 req_id = a6abd96e-4f7b-46a3-89ec-ac41a53f1120 response_code = 204 uri = /config
812026-09-03T02:14:12.198ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33252, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:64215 req_id = 14bef76d-47ca-4240-afb4-cdd22ef379fc
822026-09-03T02:14:12.295ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:64325
832026-09-03T02:14:12.295ZINFOdns-server (http): request completed latency_us = 186 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:64325 req_id = 352bdba1-47f2-4c86-b68b-59d04e66c15f response_code = 200 uri = /config
842026-09-03T02:14:20.345ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22319, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53274 req_id = 469c7f3f-eca6-43fc-910c-f603f80f6366
852026-09-03T02:14:30.348ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8359, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:64596 req_id = c92b775c-f912-48bb-b484-79564a110ab4
862026-09-03T02:14:40.350ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25187, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56203 req_id = 259cc155-4b12-449d-bc66-747ab0010ed9
872026-09-03T02:14:50.352ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2163, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:64203 req_id = 72e2dc7c-2e9c-4788-9205-ef32041dff4c
882026-09-03T02:15:00.187ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44042, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:63797 req_id = a72b22c3-10f4-4f69-a0ec-342c887d4c8b
892026-09-03T02:15:00.188ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44042, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:64893 req_id = f7e96883-ae48-48ee-8931-36ee9e158073
902026-09-03T02:15:00.232ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50821, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_9a21353e-d1f7-49e8-bd46-6a3758a70116."), ), original: Query { name: Name("oxz_ntp_9a21353e-d1f7-49e8-bd46-6a3758a70116."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 57, 97, 50, 49, 51, 53, 51, 101, 45, 100, 49, 102, 55, 45, 52, 57, 101, 56, 45, 98, 100, 52, 54, 45, 54, 97, 51, 55, 53, 56, 97, 55, 48, 49, 49, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_9a21353e-d1f7-49e8-bd46-6a3758a70116." peer_addr = [fd00:1122:3344:101::1b]:58402 req_id = c99cc0a4-c1d4-4a09-a4f6-ec4e75ba5c30
912026-09-03T02:15:00.353ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42597, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53450 req_id = 0268ec77-3251-4545-b164-6a4bdb1e68ca
922026-09-03T02:15:00.383ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41112, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), ), original: Query { name: Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 97, 57, 97, 51, 57, 53, 101, 49, 45, 52, 55, 54, 57, 45, 52, 54, 52, 53, 45, 98, 98, 102, 51, 45, 54, 55, 54, 97, 57, 53, 97, 57, 56, 53, 56, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581." peer_addr = [fd00:1122:3344:101::e]:36417 req_id = 963709a0-d6d5-4954-8b1c-6b8f2ee931a1
932026-09-03T02:15:00.383ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41112, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), ), original: Query { name: Name("oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 97, 57, 97, 51, 57, 53, 101, 49, 45, 52, 55, 54, 57, 45, 52, 54, 52, 53, 45, 98, 98, 102, 51, 45, 54, 55, 54, 97, 57, 53, 97, 57, 56, 53, 56, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_a9a395e1-4769-4645-bbf3-676a95a98581." peer_addr = [fd00:1122:3344:101::e]:60725 req_id = 438316d3-20cd-419b-871c-151b3a21a310
942026-09-03T02:15:00.417ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43944, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade."), ), original: Query { name: Name("oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 56, 101, 99, 50, 100, 49, 99, 45, 48, 55, 52, 52, 45, 52, 52, 53, 56, 45, 97, 97, 56, 100, 45, 50, 52, 54, 98, 50, 97, 50, 100, 52, 97, 100, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade." peer_addr = [fd00:1122:3344:101::3]:58137 req_id = a28cdd9b-610e-4d99-9125-98c4442253ce
952026-09-03T02:15:00.418ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43944, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade."), ), original: Query { name: Name("oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 56, 101, 99, 50, 100, 49, 99, 45, 48, 55, 52, 52, 45, 52, 52, 53, 56, 45, 97, 97, 56, 100, 45, 50, 52, 54, 98, 50, 97, 50, 100, 52, 97, 100, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f8ec2d1c-0744-4458-aa8d-246b2a2d4ade." peer_addr = [fd00:1122:3344:101::3]:36090 req_id = 89d24356-b3de-4134-a70c-52040907ff89
962026-09-03T02:15:00.420ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26499, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d."), ), original: Query { name: Name("oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 53, 50, 100, 50, 53, 48, 45, 99, 100, 99, 100, 45, 52, 100, 53, 54, 45, 57, 50, 56, 55, 45, 51, 102, 102, 99, 55, 56, 97, 99, 52, 101, 50, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d." peer_addr = [fd00:1122:3344:101::4]:48887 req_id = 98214802-5ee3-4df6-987b-292c8f3c8f2d
972026-09-03T02:15:00.421ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26499, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d."), ), original: Query { name: Name("oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 53, 50, 100, 50, 53, 48, 45, 99, 100, 99, 100, 45, 52, 100, 53, 54, 45, 57, 50, 56, 55, 45, 51, 102, 102, 99, 55, 56, 97, 99, 52, 101, 50, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8852d250-cdcd-4d56-9287-3ffc78ac4e2d." peer_addr = [fd00:1122:3344:101::4]:35859 req_id = 4cbf65c4-40d7-46fe-964a-66c114d879cb
982026-09-03T02:15:00.458ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea."), ), original: Query { name: Name("oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 48, 49, 55, 100, 101, 97, 97, 45, 101, 101, 102, 55, 45, 52, 102, 48, 100, 45, 57, 102, 50, 49, 45, 49, 48, 52, 50, 54, 52, 57, 100, 51, 51, 101, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea." peer_addr = [fd00:1122:3344:101::6]:43253 req_id = 52e29af1-351d-4bf5-8bf2-5821a363664f
992026-09-03T02:15:00.459ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea."), ), original: Query { name: Name("oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 48, 49, 55, 100, 101, 97, 97, 45, 101, 101, 102, 55, 45, 52, 102, 48, 100, 45, 57, 102, 50, 49, 45, 49, 48, 52, 50, 54, 52, 57, 100, 51, 51, 101, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8017deaa-eef7-4f0d-9f21-1042649d33ea." peer_addr = [fd00:1122:3344:101::6]:47914 req_id = 4ddc1632-35a4-4142-a8bb-a7cc0118cc1e
1002026-09-03T02:15:00.467ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31410, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf."), ), original: Query { name: Name("oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 55, 102, 50, 100, 101, 99, 52, 45, 99, 54, 50, 51, 45, 52, 53, 98, 97, 45, 57, 98, 52, 51, 45, 97, 101, 101, 55, 99, 51, 55, 100, 55, 57, 99, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf." peer_addr = [fd00:1122:3344:101::5]:61451 req_id = 111ddda9-4ab5-4258-b417-0e098b797ac4
1012026-09-03T02:15:00.468ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31410, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf."), ), original: Query { name: Name("oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 55, 102, 50, 100, 101, 99, 52, 45, 99, 54, 50, 51, 45, 52, 53, 98, 97, 45, 57, 98, 52, 51, 45, 97, 101, 101, 55, 99, 51, 55, 100, 55, 57, 99, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_47f2dec4-c623-45ba-9b43-aee7c37d79cf." peer_addr = [fd00:1122:3344:101::5]:60822 req_id = e32dd211-e0e7-4eae-a3be-3f39329e5333
1022026-09-03T02:15:00.490ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9954, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6."), ), original: Query { name: Name("oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 53, 55, 55, 57, 54, 51, 102, 45, 54, 56, 53, 52, 45, 52, 51, 101, 48, 45, 97, 57, 102, 100, 45, 55, 57, 50, 53, 57, 51, 98, 50, 97, 98, 99, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6." peer_addr = [fd00:1122:3344:101::7]:49016 req_id = 2e4af602-2de6-4593-94c8-dee32d49b16f
1032026-09-03T02:15:00.490ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9954, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6."), ), original: Query { name: Name("oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 53, 55, 55, 57, 54, 51, 102, 45, 54, 56, 53, 52, 45, 52, 51, 101, 48, 45, 97, 57, 102, 100, 45, 55, 57, 50, 53, 57, 51, 98, 50, 97, 98, 99, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3577963f-6854-43e0-a9fd-792593b2abc6." peer_addr = [fd00:1122:3344:101::7]:56826 req_id = 6d37b753-4ebe-407c-8ae3-49bf02e3b616