Max level shown:
1 [ Aug 25 09:26:10 Enabled. ]
2 [ Aug 25 09:26:10 Rereading configuration. ]
3 [ Aug 25 09:26:11 Rereading configuration. ]
4 [ Aug 25 09:26:12 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ Aug 25 09:26:12 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-08-25T09:26:12.610ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-08-25T09:26:12.610ZINFOdns-server (store): opening sled database path = /data/dns
102026-08-25T09:26:12.631ZINFOdns-server (store): pruning trees for generations newer than 0
112026-08-25T09:26:12.631ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-08-25T09:26:12.632ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-08-25T09:26:12.632ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-08-25T09:26:12.692ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:48423
152026-08-25T09:26:12.692ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = ed1417b3-2258-4bc6-9828-1b57783f597e
162026-08-25T09:26:12.693ZINFOdns-server (store): pruning trees for generations newer than 0
172026-08-25T09:26:12.715ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-08-25T09:26:12.715ZINFOdns-server (store): updated generation new_generation = 1 req_id = ed1417b3-2258-4bc6-9828-1b57783f597e
192026-08-25T09:26:12.715ZINFOdns-server (http): request completed latency_us = 23047 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:48423 req_id = ed1417b3-2258-4bc6-9828-1b57783f597e response_code = 204 uri = /config
202026-08-25T09:26:24.097ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55557, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:46164 req_id = 32ac3776-f4b2-439a-98ba-a0ce69fc3f3b
212026-08-25T09:26:24.101ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45219, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:33439 req_id = d0b4d265-8504-4b30-8b8e-da4cf46e3952
222026-08-25T09:26:24.108ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19362, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59885 req_id = a5284353-9aa8-45fa-848f-2c2bacffc717
232026-08-25T09:27:47.407ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49890, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:46447 req_id = 6170ffb3-c80e-4c19-bb67-c756866bcce4
242026-08-25T09:27:47.412ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32139, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:61051 req_id = 6a08a9ec-7894-4146-883e-01c142e8de07
252026-08-25T09:27:47.416ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41929, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35115 req_id = 25f45c33-0087-44eb-bf31-9d2bce252b1a
262026-08-25T09:29:26.852ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17223, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:60666 req_id = 7fb8d732-dc11-4944-bcce-a163116fdc6b
272026-08-25T09:29:28.524ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58699, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), ), original: Query { name: Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 49, 56, 53, 51, 98, 49, 49, 45, 102, 56, 99, 98, 45, 52, 49, 101, 56, 45, 97, 98, 51, 49, 45, 48, 54, 57, 54, 50, 51, 50, 56, 54, 53, 52, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545." peer_addr = [fd00:1122:3344:101::e]:48246 req_id = 05ffc6ac-bd4d-43a9-b393-478a47922aa9
282026-08-25T09:29:28.539ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58699, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), ), original: Query { name: Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 49, 56, 53, 51, 98, 49, 49, 45, 102, 56, 99, 98, 45, 52, 49, 101, 56, 45, 97, 98, 51, 49, 45, 48, 54, 57, 54, 50, 51, 50, 56, 54, 53, 52, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545." peer_addr = [fd00:1122:3344:101::e]:55959 req_id = 5d80295e-6480-42ef-853e-362fc8e1275c
292026-08-25T09:29:36.832ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59220, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54554 req_id = 3a889caa-fe9e-4c15-a2ca-9c5b566f191f
302026-08-25T09:29:37.273ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20720, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:48520 req_id = 770764a0-49e5-4be2-a8f2-7a9f22f274d8
312026-08-25T09:29:38.402ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28206, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:9640 req_id = 41b54c64-2bc8-4c01-94df-32ee2eda3aa3
322026-08-25T09:29:38.418ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8411, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:1899 req_id = c288ff59-1fe0-4c3c-8adf-c185c00a5d68
332026-08-25T09:29:40.193ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:52561
342026-08-25T09:29:40.197ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:52048
352026-08-25T09:29:40.198ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:42991
362026-08-25T09:29:40.231ZINFOdns-server (http): request completed latency_us = 18264 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:52048 req_id = 077fc5ed-b91e-41b7-9cb8-44cb190f6198 response_code = 200 uri = /config
372026-08-25T09:29:40.231ZINFOdns-server (http): request completed latency_us = 18263 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:42991 req_id = 9dcd1b58-bc53-4404-af07-0af60a548043 response_code = 200 uri = /config
382026-08-25T09:29:40.231ZINFOdns-server (http): request completed latency_us = 18276 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:52561 req_id = 88b13ee2-8e45-4c28-a742-b884b886a2ac response_code = 200 uri = /config
392026-08-25T09:29:40.578ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:55805
402026-08-25T09:29:40.578ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 715c892b-dfbc-4df7-8382-33f8dd386386
412026-08-25T09:29:40.578ZINFOdns-server (store): updated generation new_generation = 1 req_id = 715c892b-dfbc-4df7-8382-33f8dd386386
422026-08-25T09:29:40.578ZINFOdns-server (http): request completed latency_us = 348 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:55805 req_id = 715c892b-dfbc-4df7-8382-33f8dd386386 response_code = 204 uri = /config
432026-08-25T09:29:41.590ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40551, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:62815 req_id = 6109cf3e-e43f-4de8-9242-63a1d58e8d64
442026-08-25T09:29:41.841ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37900
452026-08-25T09:29:41.841ZINFOdns-server (http): request completed latency_us = 198 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:37900 req_id = 1337dcdb-42e3-475c-812e-767c483b1b20 response_code = 200 uri = /config
462026-08-25T09:29:42.498ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19810, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:17689 req_id = 1ccb89fc-b1b3-4d59-8102-40e2644311de
472026-08-25T09:29:42.765ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:35085
482026-08-25T09:29:42.765ZINFOdns-server (http): request completed latency_us = 269 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:35085 req_id = be16c9c8-d918-4965-877d-a522ea22d239 response_code = 200 uri = /config
492026-08-25T09:29:43.271ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13265, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:8688 req_id = eac3d75e-b0ae-4db0-a71a-ca3e254860b1
502026-08-25T09:29:43.404ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:34054
512026-08-25T09:29:43.404ZINFOdns-server (http): request completed latency_us = 262 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:34054 req_id = 5e4748a8-d064-47df-b6c6-7142e7da5218 response_code = 200 uri = /config
522026-08-25T09:29:46.834ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64753, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61102 req_id = 689e0af4-f2fe-45e2-860c-d4db00c3dc0e
532026-08-25T09:29:48.182ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5587, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:33665 req_id = 1857c5f9-5372-4855-bc33-bf5d42f1772a
542026-08-25T09:29:48.317ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::b]:63672
552026-08-25T09:29:48.318ZINFOdns-server (http): request completed latency_us = 220 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:63672 req_id = 96694210-6621-4aba-91c7-5b6d04b13b50 response_code = 200 uri = /config
562026-08-25T09:29:49.331ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35137, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:32926 req_id = 68c9a265-db0c-4e90-b45d-d54ca14a10c7
572026-08-25T09:29:49.460ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:62064
582026-08-25T09:29:49.461ZINFOdns-server (http): request completed latency_us = 187 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:62064 req_id = c72b24c6-c9b8-4aca-b20a-800b202a18fb response_code = 200 uri = /config
592026-08-25T09:29:56.836ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13612, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63764 req_id = 74d866ff-54d2-4552-aff5-716a4666fbd2
602026-08-25T09:30:00.068ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51267, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_3c73a37a-8db4-47f7-95ab-e59b4345c1a2."), ), original: Query { name: Name("oxz_ntp_3c73a37a-8db4-47f7-95ab-e59b4345c1a2."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 51, 99, 55, 51, 97, 51, 55, 97, 45, 56, 100, 98, 52, 45, 52, 55, 102, 55, 45, 57, 53, 97, 98, 45, 101, 53, 57, 98, 52, 51, 52, 53, 99, 49, 97, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_3c73a37a-8db4-47f7-95ab-e59b4345c1a2." peer_addr = [fd00:1122:3344:101::1b]:36954 req_id = 70e2caaf-9853-4db8-99f1-68162dc94107
612026-08-25T09:30:00.160ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12380, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8."), ), original: Query { name: Name("oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 97, 102, 97, 101, 48, 97, 100, 45, 54, 50, 54, 102, 45, 52, 97, 97, 53, 45, 57, 53, 51, 100, 45, 53, 50, 52, 53, 101, 55, 56, 100, 102, 50, 98, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8." peer_addr = [fd00:1122:3344:101::4]:45314 req_id = fccac384-37bb-40ab-afb1-594b371b3c0f
622026-08-25T09:30:00.161ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12380, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8."), ), original: Query { name: Name("oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 97, 102, 97, 101, 48, 97, 100, 45, 54, 50, 54, 102, 45, 52, 97, 97, 53, 45, 57, 53, 51, 100, 45, 53, 50, 52, 53, 101, 55, 56, 100, 102, 50, 98, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5afae0ad-626f-4aa5-953d-5245e78df2b8." peer_addr = [fd00:1122:3344:101::4]:49651 req_id = 23383edf-9ed0-4c93-bfa0-2888a78e9c31
632026-08-25T09:30:00.246ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37409, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), ), original: Query { name: Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 49, 56, 53, 51, 98, 49, 49, 45, 102, 56, 99, 98, 45, 52, 49, 101, 56, 45, 97, 98, 51, 49, 45, 48, 54, 57, 54, 50, 51, 50, 56, 54, 53, 52, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545." peer_addr = [fd00:1122:3344:101::e]:40176 req_id = 5e8eaecd-bef4-4858-9b66-b5b5ec27b77a
642026-08-25T09:30:00.247ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37409, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), ), original: Query { name: Name("oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 54, 49, 56, 53, 51, 98, 49, 49, 45, 102, 56, 99, 98, 45, 52, 49, 101, 56, 45, 97, 98, 51, 49, 45, 48, 54, 57, 54, 50, 51, 50, 56, 54, 53, 52, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_61853b11-f8cb-41e8-ab31-069623286545." peer_addr = [fd00:1122:3344:101::e]:43432 req_id = 60b153b9-1dc9-4fed-a594-14e10b83b2ec
652026-08-25T09:30:00.513ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54820, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:38258 req_id = a9b5ccff-2dc5-4097-9675-d7ddc19a09c8
662026-08-25T09:30:00.514ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54820, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:33239 req_id = d088d747-cf06-47c1-acf0-3903eeea2ebd
672026-08-25T09:30:00.950ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52022, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc."), ), original: Query { name: Name("oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 99, 48, 98, 102, 98, 55, 55, 45, 56, 98, 53, 50, 45, 52, 52, 101, 99, 45, 97, 57, 53, 57, 45, 51, 99, 53, 55, 102, 55, 102, 51, 50, 57, 98, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc." peer_addr = [fd00:1122:3344:101::7]:64804 req_id = 7469dbc9-fb64-40e0-8e77-ec5f713ca425
682026-08-25T09:30:00.951ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52022, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc."), ), original: Query { name: Name("oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 99, 48, 98, 102, 98, 55, 55, 45, 56, 98, 53, 50, 45, 52, 52, 101, 99, 45, 97, 57, 53, 57, 45, 51, 99, 53, 55, 102, 55, 102, 51, 50, 57, 98, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_cc0bfb77-8b52-44ec-a959-3c57f7f329bc." peer_addr = [fd00:1122:3344:101::7]:64134 req_id = fbc05957-613f-4279-b83b-130e8d0a48dc
692026-08-25T09:30:00.975ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37040, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e."), ), original: Query { name: Name("oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 51, 100, 99, 98, 56, 54, 101, 45, 99, 54, 54, 98, 45, 52, 102, 48, 97, 45, 97, 101, 97, 101, 45, 54, 55, 100, 98, 57, 55, 51, 49, 55, 57, 51, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e." peer_addr = [fd00:1122:3344:101::6]:56129 req_id = e2d541cd-78a0-41be-9fbd-295d47bd7fb2
702026-08-25T09:30:00.975ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37040, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e."), ), original: Query { name: Name("oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 51, 100, 99, 98, 56, 54, 101, 45, 99, 54, 54, 98, 45, 52, 102, 48, 97, 45, 97, 101, 97, 101, 45, 54, 55, 100, 98, 57, 55, 51, 49, 55, 57, 51, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_33dcb86e-c66b-4f0a-aeae-67db9731793e." peer_addr = [fd00:1122:3344:101::6]:57599 req_id = 3b4656a0-cdea-4982-b482-e70019b86743
712026-08-25T09:30:00.979ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4430, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f."), ), original: Query { name: Name("oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 52, 55, 52, 99, 99, 50, 55, 45, 56, 97, 55, 50, 45, 52, 56, 100, 102, 45, 97, 49, 56, 97, 45, 49, 98, 49, 99, 101, 54, 48, 49, 57, 51, 54, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f." peer_addr = [fd00:1122:3344:101::5]:53030 req_id = 3ab0809b-cca2-4f66-9932-f4946f9c3bdf
722026-08-25T09:30:00.980ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4430, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f."), ), original: Query { name: Name("oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 52, 55, 52, 99, 99, 50, 55, 45, 56, 97, 55, 50, 45, 52, 56, 100, 102, 45, 97, 49, 56, 97, 45, 49, 98, 49, 99, 101, 54, 48, 49, 57, 51, 54, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3474cc27-8a72-48df-a18a-1b1ce601936f." peer_addr = [fd00:1122:3344:101::5]:39875 req_id = d69c9b0e-6dd1-40d6-88c4-52508856b90b
732026-08-25T09:30:01.011ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55805, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616."), ), original: Query { name: Name("oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 98, 100, 57, 55, 100, 50, 55, 45, 54, 98, 48, 99, 45, 52, 98, 50, 98, 45, 57, 97, 97, 54, 45, 57, 99, 48, 99, 56, 97, 51, 54, 102, 54, 49, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616." peer_addr = [fd00:1122:3344:101::3]:35792 req_id = ed4c12b1-538b-4a92-a1fe-826a4d2cbddc
742026-08-25T09:30:01.011ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55805, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616."), ), original: Query { name: Name("oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 98, 100, 57, 55, 100, 50, 55, 45, 54, 98, 48, 99, 45, 52, 98, 50, 98, 45, 57, 97, 97, 54, 45, 57, 99, 48, 99, 56, 97, 51, 54, 102, 54, 49, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ebd97d27-6b0c-4b2b-9aa6-9c0c8a36f616." peer_addr = [fd00:1122:3344:101::3]:56790 req_id = 5ad6b272-6c15-4502-a148-6b178da36bd6