Max level shown:
1 [ May 18 23:57:31 Enabled. ]
2 [ May 18 23:57:31 Rereading configuration. ]
3 [ May 18 23:57:31 Rereading configuration. ]
4 [ May 18 23:57:32 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ May 18 23:57:32 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-05-18T23:57:32.860ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-05-18T23:57:32.861ZINFOdns-server (store): opening sled database path = /data/dns
102026-05-18T23:57:32.892ZINFOdns-server (store): pruning trees for generations newer than 0
112026-05-18T23:57:32.892ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-05-18T23:57:32.892ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-05-18T23:57:32.892ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-05-18T23:57:32.951ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:46599
152026-05-18T23:57:32.952ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 74406f07-78ef-4ec8-b869-279dab33e6de
162026-05-18T23:57:32.952ZINFOdns-server (store): pruning trees for generations newer than 0
172026-05-18T23:57:32.965ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-05-18T23:57:32.965ZINFOdns-server (store): updated generation new_generation = 1 req_id = 74406f07-78ef-4ec8-b869-279dab33e6de
192026-05-18T23:57:32.965ZINFOdns-server (http): request completed latency_us = 13396 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:46599 req_id = 74406f07-78ef-4ec8-b869-279dab33e6de response_code = 204 uri = /config
202026-05-18T23:57:45.427ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18992, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:55453 req_id = 93ab1648-86bd-4a2a-8637-bbf65dc8dce4
212026-05-18T23:57:45.432ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:55199 req_id = e88b84b1-5373-432b-a5e4-f54c08eff652
222026-05-18T23:57:45.436ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23076, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59086 req_id = 24b4c700-4071-4e4c-a33b-4ce55bf125b9
232026-05-18T23:58:58.092ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60588, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56929 req_id = 07590653-22b3-45d0-a32d-ff0e99814768
242026-05-18T23:59:03.923ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9337, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), ), original: Query { name: Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 48, 52, 54, 99, 99, 53, 97, 97, 45, 57, 53, 97, 97, 45, 52, 99, 98, 48, 45, 97, 54, 52, 56, 45, 99, 98, 54, 52, 54, 101, 50, 101, 101, 49, 50, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a." peer_addr = [fd00:1122:3344:101::e]:32865 req_id = 0ec56267-59d9-4dd9-8275-e0d628bad7dd
252026-05-18T23:59:03.931ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9337, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), ), original: Query { name: Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 48, 52, 54, 99, 99, 53, 97, 97, 45, 57, 53, 97, 97, 45, 52, 99, 98, 48, 45, 97, 54, 52, 56, 45, 99, 98, 54, 52, 54, 101, 50, 101, 101, 49, 50, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a." peer_addr = [fd00:1122:3344:101::e]:47023 req_id = 91dd5366-805d-4083-85e7-9cc17ac0c880
262026-05-18T23:59:08.072ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47627, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63132 req_id = d9498de2-9b9f-4cfb-9a8d-e051fbdc80e3
272026-05-18T23:59:12.028ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14032, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:8486 req_id = db9f0e84-f461-4539-a19c-0f8b7720b48f
282026-05-18T23:59:12.043ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30887, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:3385 req_id = 50a1fe55-e28e-425e-9c27-35b4ae6853a9
292026-05-18T23:59:12.049ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6440, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:64377 req_id = f099bedc-349b-4409-9112-5b0b03778c61
302026-05-18T23:59:18.074ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24090, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55692 req_id = 8e06969f-b0c1-4b37-9039-0f11bc5f70da
312026-05-18T23:59:28.076ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40029, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57025 req_id = 58add740-b556-4611-a6a2-b5a8ea220c4a
322026-05-18T23:59:38.078ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19455, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:60347 req_id = eaa93067-45ac-4691-9ecd-eddf9bc1baa2
332026-05-18T23:59:46.506ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40584, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:60386 req_id = b35fb729-a1d3-4fd7-a2c4-f42e57dd381b
342026-05-18T23:59:46.510ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7817, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:53330 req_id = a04c930a-b0bd-43cb-af69-d903b0ded651
352026-05-18T23:59:46.514ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2107, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:54009 req_id = f3476615-2532-4150-baf0-d8c7abac87bd
362026-05-18T23:59:48.081ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42012, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63577 req_id = fcc22b10-1764-44e2-8626-800dc28acb80
372026-05-18T23:59:53.854ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49711, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:44473 req_id = 9bc368cb-0ef9-4c4f-8ae7-d901650434fe
382026-05-18T23:59:54.171ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:33608
392026-05-18T23:59:54.251ZINFOdns-server (http): request completed latency_us = 49870 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:33608 req_id = ac9d3ef6-3787-4cb5-af1b-1dd697bad379 response_code = 200 uri = /config
402026-05-18T23:59:55.266ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10690, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:29281 req_id = 91512273-9b5e-4652-abe0-5b2046df9ce7
412026-05-18T23:59:55.294ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:38897
422026-05-18T23:59:55.297ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1130d55f-2dc1-4ff6-8807-01c68f9db3de
432026-05-18T23:59:55.297ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1130d55f-2dc1-4ff6-8807-01c68f9db3de
442026-05-18T23:59:55.297ZINFOdns-server (http): request completed latency_us = 305 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:38897 req_id = 1130d55f-2dc1-4ff6-8807-01c68f9db3de response_code = 204 uri = /config
452026-05-18T23:59:55.463ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:53376
462026-05-18T23:59:55.463ZINFOdns-server (http): request completed latency_us = 197 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:53376 req_id = 3b37b6aa-57a2-4229-bfaf-61d4fd086d50 response_code = 200 uri = /config
472026-05-18T23:59:56.112ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56127, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:47544 req_id = ee09dd6f-712e-466d-9ace-edeefc8e1a78
482026-05-18T23:59:56.217ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::a]:45531
492026-05-18T23:59:56.217ZINFOdns-server (http): request completed latency_us = 203 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:45531 req_id = 156d89cc-2a8a-4b00-a4ae-5f22b7e74082 response_code = 200 uri = /config
502026-05-18T23:59:58.082ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16849, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61033 req_id = 27b40014-885a-4b54-bf74-5016ca77f49f
512026-05-19T00:00:00.116ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33884, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), ), original: Query { name: Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 48, 52, 54, 99, 99, 53, 97, 97, 45, 57, 53, 97, 97, 45, 52, 99, 98, 48, 45, 97, 54, 52, 56, 45, 99, 98, 54, 52, 54, 101, 50, 101, 101, 49, 50, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a." peer_addr = [fd00:1122:3344:101::e]:45451 req_id = 8d97e71c-d631-4196-9890-ce8e42a6f6cf
522026-05-19T00:00:00.117ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33884, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), ), original: Query { name: Name("oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 48, 52, 54, 99, 99, 53, 97, 97, 45, 57, 53, 97, 97, 45, 52, 99, 98, 48, 45, 97, 54, 52, 56, 45, 99, 98, 54, 52, 54, 101, 50, 101, 101, 49, 50, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_046cc5aa-95aa-4cb0-a648-cb646e2ee12a." peer_addr = [fd00:1122:3344:101::e]:42186 req_id = 4ea915fe-a888-4008-9a4c-c9da05711cfe
532026-05-19T00:00:00.130ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4530, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc."), ), original: Query { name: Name("oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 97, 97, 49, 55, 55, 101, 102, 45, 98, 50, 97, 100, 45, 52, 56, 55, 51, 45, 97, 100, 54, 100, 45, 49, 49, 52, 97, 55, 56, 48, 54, 54, 100, 100, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc." peer_addr = [fd00:1122:3344:101::4]:46278 req_id = 2ad80089-33b6-4937-9d8c-0224b2a9d6ea
542026-05-19T00:00:00.131ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4530, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc."), ), original: Query { name: Name("oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 97, 97, 49, 55, 55, 101, 102, 45, 98, 50, 97, 100, 45, 52, 56, 55, 51, 45, 97, 100, 54, 100, 45, 49, 49, 52, 97, 55, 56, 48, 54, 54, 100, 100, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9aa177ef-b2ad-4873-ad6d-114a78066ddc." peer_addr = [fd00:1122:3344:101::4]:57427 req_id = 5e601356-7c04-4226-b462-d826cfe1cfdc
552026-05-19T00:00:00.175ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2745, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60."), ), original: Query { name: Name("oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 53, 55, 53, 56, 100, 57, 49, 45, 50, 56, 102, 56, 45, 52, 49, 98, 48, 45, 97, 56, 54, 101, 45, 57, 54, 100, 102, 54, 101, 55, 52, 99, 99, 54, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60." peer_addr = [fd00:1122:3344:101::3]:65185 req_id = 417b9c5a-b185-41da-baec-58ddc6aec835
562026-05-19T00:00:00.175ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2745, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60."), ), original: Query { name: Name("oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 53, 55, 53, 56, 100, 57, 49, 45, 50, 56, 102, 56, 45, 52, 49, 98, 48, 45, 97, 56, 54, 101, 45, 57, 54, 100, 102, 54, 101, 55, 52, 99, 99, 54, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b5758d91-28f8-41b0-a86e-96df6e74cc60." peer_addr = [fd00:1122:3344:101::3]:57100 req_id = 501ad549-26fe-42d0-9ecc-b8be0cdf0193
572026-05-19T00:00:00.184ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64100, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c."), ), original: Query { name: Name("oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 101, 50, 101, 48, 50, 101, 99, 45, 48, 51, 99, 52, 45, 52, 98, 100, 99, 45, 56, 49, 99, 57, 45, 98, 49, 99, 55, 53, 97, 101, 56, 102, 50, 51, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c." peer_addr = [fd00:1122:3344:101::5]:44687 req_id = 58461b1e-fa25-40e1-bd95-573042b4a9e3
582026-05-19T00:00:00.185ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64100, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c."), ), original: Query { name: Name("oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 101, 50, 101, 48, 50, 101, 99, 45, 48, 51, 99, 52, 45, 52, 98, 100, 99, 45, 56, 49, 99, 57, 45, 98, 49, 99, 55, 53, 97, 101, 56, 102, 50, 51, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3e2e02ec-03c4-4bdc-81c9-b1c75ae8f23c." peer_addr = [fd00:1122:3344:101::5]:37211 req_id = f74061ef-3b75-400a-9602-d06bcbd932b6
592026-05-19T00:00:00.904ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14606, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0."), ), original: Query { name: Name("oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 49, 52, 56, 52, 57, 50, 49, 45, 49, 49, 48, 54, 45, 52, 57, 100, 102, 45, 98, 50, 102, 51, 45, 51, 55, 101, 50, 56, 98, 102, 101, 48, 102, 102, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0." peer_addr = [fd00:1122:3344:101::6]:37522 req_id = 4829ef4e-7918-4a42-96cc-5ed06a15a452
602026-05-19T00:00:00.905ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14606, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0."), ), original: Query { name: Name("oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 49, 52, 56, 52, 57, 50, 49, 45, 49, 49, 48, 54, 45, 52, 57, 100, 102, 45, 98, 50, 102, 51, 45, 51, 55, 101, 50, 56, 98, 102, 101, 48, 102, 102, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a1484921-1106-49df-b2f3-37e28bfe0ff0." peer_addr = [fd00:1122:3344:101::6]:64702 req_id = 513cf9f6-95dc-44bf-9fbb-263d249b1cee
612026-05-19T00:00:00.954ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39124, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57."), ), original: Query { name: Name("oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 102, 56, 102, 51, 50, 102, 54, 45, 53, 56, 50, 55, 45, 52, 100, 97, 50, 45, 97, 51, 102, 54, 45, 98, 52, 102, 101, 48, 53, 55, 52, 52, 98, 53, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57." peer_addr = [fd00:1122:3344:101::7]:63197 req_id = b37adf14-d05a-4e38-add0-9ab2dc0496a0
622026-05-19T00:00:00.955ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39124, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57."), ), original: Query { name: Name("oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 102, 56, 102, 51, 50, 102, 54, 45, 53, 56, 50, 55, 45, 52, 100, 97, 50, 45, 97, 51, 102, 54, 45, 98, 52, 102, 101, 48, 53, 55, 52, 52, 98, 53, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9f8f32f6-5827-4da2-a3f6-b4fe05744b57." peer_addr = [fd00:1122:3344:101::7]:36393 req_id = 667acfca-b6ed-4311-a2c0-22f3f5f84fa8
632026-05-19T00:00:01.055ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45682, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_0285cb68-7ec8-485c-8343-aa642962ddd1."), ), original: Query { name: Name("oxz_ntp_0285cb68-7ec8-485c-8343-aa642962ddd1."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 48, 50, 56, 53, 99, 98, 54, 56, 45, 55, 101, 99, 56, 45, 52, 56, 53, 99, 45, 56, 51, 52, 51, 45, 97, 97, 54, 52, 50, 57, 54, 50, 100, 100, 100, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_0285cb68-7ec8-485c-8343-aa642962ddd1." peer_addr = [fd00:1122:3344:101::1b]:61340 req_id = f3c70d08-2916-416d-bc7f-b63023a870dc
642026-05-19T00:00:01.546ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18215, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:40421 req_id = be715658-9c18-4f01-a65d-ac7d682024ae
652026-05-19T00:00:01.547ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18215, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:61457 req_id = d9959364-caad-4227-a7f3-c9e67f917e69