Max level shown:
1 [ Apr 10 03:10:08 Enabled. ]
2 [ Apr 10 03:10:08 Rereading configuration. ]
3 [ Apr 10 03:10:09 Rereading configuration. ]
4 [ Apr 10 03:10:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Apr 10 03:10:11 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-04-10T03:10:11.014ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-04-10T03:10:11.014ZINFOdns-server (store): opening sled database path = /data/dns
102026-04-10T03:10:11.033ZINFOdns-server (store): pruning trees for generations newer than 0
112026-04-10T03:10:11.033ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-04-10T03:10:11.033ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-04-10T03:10:11.033ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-04-10T03:10:11.345ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14724, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:3::2]:53221 req_id = 77b51a47-28eb-4885-b7de-4df16839b661
152026-04-10T03:10:11.418ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:59919
162026-04-10T03:10:11.419ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 71dcbc2b-aee2-4d58-afdb-4c42c1d72930
172026-04-10T03:10:11.419ZINFOdns-server (store): pruning trees for generations newer than 0
182026-04-10T03:10:11.464ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
192026-04-10T03:10:11.464ZINFOdns-server (store): updated generation new_generation = 1 req_id = 71dcbc2b-aee2-4d58-afdb-4c42c1d72930
202026-04-10T03:10:11.464ZINFOdns-server (http): request completed latency_us = 45772 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:59919 req_id = 71dcbc2b-aee2-4d58-afdb-4c42c1d72930 response_code = 204 uri = /config
212026-04-10T03:10:23.762ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57235, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:36208 req_id = 01d2c9f2-dc6b-4afc-b0df-ce7843138010
222026-04-10T03:10:23.769ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17752, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:63367 req_id = eb68d840-a7ff-4da2-b0dc-1dbeb4e540ca
232026-04-10T03:10:23.774ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54598, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:41887 req_id = 3cfa0491-3c3f-49d6-b071-59c0ec58e673
242026-04-10T03:11:48.403ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30478, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:56635 req_id = 10e6d850-4ecf-4f99-872c-eb2a5016af44
252026-04-10T03:11:48.408ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7615, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:55502 req_id = f8dd0c73-bdbc-423a-ad0a-c3493b5ccf60
262026-04-10T03:11:48.412ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43544, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:47630 req_id = 7ff7b7c0-b12f-4286-941a-9df4f516878c
272026-04-10T03:13:44.597ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58444, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:65488 req_id = 73d23f64-20fd-4cc7-ad46-6fd9ba7f4be6
282026-04-10T03:13:47.305ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43122, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), ), original: Query { name: Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 52, 51, 54, 50, 54, 102, 54, 45, 98, 102, 98, 99, 45, 52, 55, 52, 50, 45, 57, 99, 52, 56, 45, 49, 55, 102, 49, 52, 101, 54, 49, 51, 98, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68." peer_addr = [fd00:1122:3344:101::e]:41002 req_id = 6990b2e3-68b7-465d-b08e-ea15e6973331
292026-04-10T03:13:47.305ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43122, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), ), original: Query { name: Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 52, 51, 54, 50, 54, 102, 54, 45, 98, 102, 98, 99, 45, 52, 55, 52, 50, 45, 57, 99, 52, 56, 45, 49, 55, 102, 49, 52, 101, 54, 49, 51, 98, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68." peer_addr = [fd00:1122:3344:101::e]:37260 req_id = fd98bad7-c0ec-44c9-8644-8bbd7c3da534
302026-04-10T03:13:52.129ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64293, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:49552 req_id = 59c38f8e-b9fe-4e56-b3c7-6eb622d8174f
312026-04-10T03:13:53.346ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11103, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:40172 req_id = 3d354e06-7a5e-4161-b260-3f54779ead27
322026-04-10T03:13:53.535ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5488, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:62759 req_id = b99ac8a9-2225-497e-ac0f-0d8cc4d5f973
332026-04-10T03:13:54.093ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:55000
342026-04-10T03:13:54.096ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:33894
352026-04-10T03:13:54.133ZINFOdns-server (http): request completed latency_us = 26370 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:55000 req_id = 2285debe-36a0-47b7-a8dd-4b4c8c66d72d response_code = 200 uri = /config
362026-04-10T03:13:54.133ZINFOdns-server (http): request completed latency_us = 26371 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:33894 req_id = a1f00bd5-1465-43c2-853c-9b5dfc1dadad response_code = 200 uri = /config
372026-04-10T03:13:54.149ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58418, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:35635 req_id = ca2a3fcb-3573-4cfa-b4f9-2deeccfa5192
382026-04-10T03:13:54.271ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:53268
392026-04-10T03:13:54.273ZINFOdns-server (http): request completed latency_us = 1349 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:53268 req_id = 44e4ed6c-f1b8-4339-b76b-89c67d3228cc response_code = 200 uri = /config
402026-04-10T03:13:55.723ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28352, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:24505 req_id = 8443b295-c66e-4fa4-bd43-8c410a7ac3af
412026-04-10T03:13:55.770ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:43496
422026-04-10T03:13:55.774ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 34c19d32-b8ad-4fd7-97d0-7b9294da135a
432026-04-10T03:13:55.774ZINFOdns-server (store): updated generation new_generation = 1 req_id = 34c19d32-b8ad-4fd7-97d0-7b9294da135a
442026-04-10T03:13:55.774ZINFOdns-server (http): request completed latency_us = 3064 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:43496 req_id = 34c19d32-b8ad-4fd7-97d0-7b9294da135a response_code = 204 uri = /config
452026-04-10T03:13:55.938ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:49070
462026-04-10T03:13:55.938ZINFOdns-server (http): request completed latency_us = 211 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:49070 req_id = bb612fa9-b29a-4dea-b385-306b474779f5 response_code = 200 uri = /config
472026-04-10T03:13:56.556ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63450, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:19742 req_id = d3a28402-0371-4f8b-9b8a-4dba9b48557b
482026-04-10T03:13:56.669ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:33909
492026-04-10T03:13:56.670ZINFOdns-server (http): request completed latency_us = 758 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:33909 req_id = f9896b5e-a874-43b3-a276-3d2f37524779 response_code = 200 uri = /config
502026-04-10T03:14:04.205ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7401, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:17273 req_id = 0464a4a5-6e0e-492e-a19d-d06b8e6c1f54
512026-04-10T03:14:04.205ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52321, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:15038 req_id = 656ebf18-e582-49ef-a30b-4dedcd698b0b
522026-04-10T03:14:04.320ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:60074
532026-04-10T03:14:04.320ZINFOdns-server (http): request completed latency_us = 186 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:60074 req_id = 259c3f72-fb52-4280-a134-33292d64999f response_code = 200 uri = /config
542026-04-10T03:14:04.375ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:46486
552026-04-10T03:14:04.375ZINFOdns-server (http): request completed latency_us = 191 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:46486 req_id = 9fb32b74-c045-47ba-a4f6-f13c7ee1bc02 response_code = 200 uri = /config
562026-04-10T03:14:04.573ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37165, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55058 req_id = f7bb8746-e34c-407b-b8a5-4a6c1f0de26c
572026-04-10T03:14:14.574ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25010, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:62382 req_id = db2afb72-a8ac-4372-a139-1c9d2cf032a4
582026-04-10T03:14:16.419ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10438, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:49421 req_id = eddb5dda-913e-4aea-a380-4b6e4bb02481
592026-04-10T03:14:16.423ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6910, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:57004 req_id = c6445907-390a-4ade-89a9-6f93cf256c6c
602026-04-10T03:14:16.427ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46725, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:40298 req_id = 24665895-7822-4aab-ae88-85da066543be
612026-04-10T03:14:24.576ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36732, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56937 req_id = 3c6eeed2-c586-4c79-8537-b123339a5923
622026-04-10T03:14:34.577ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43200, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:58298 req_id = 1fd85b2a-49a3-46f6-a72b-6beff23cb3e6
632026-04-10T03:14:44.579ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6155, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:50566 req_id = 8c0a5f1c-59fb-4c41-98d2-bcb98b6d629f
642026-04-10T03:14:51.871ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:63724
652026-04-10T03:14:51.873ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 23fa76c3-3f4e-49e0-b5f5-e83451fa798e
662026-04-10T03:14:51.873ZINFOdns-server (store): updated generation new_generation = 1 req_id = 23fa76c3-3f4e-49e0-b5f5-e83451fa798e
672026-04-10T03:14:51.873ZINFOdns-server (http): request completed latency_us = 184 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:63724 req_id = 23fa76c3-3f4e-49e0-b5f5-e83451fa798e response_code = 204 uri = /config
682026-04-10T03:14:53.341ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:36118
692026-04-10T03:14:53.343ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 1ff4bed4-7fa4-4ccd-94db-964528a37151
702026-04-10T03:14:53.343ZINFOdns-server (store): updated generation new_generation = 1 req_id = 1ff4bed4-7fa4-4ccd-94db-964528a37151
712026-04-10T03:14:53.343ZINFOdns-server (http): request completed latency_us = 284 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:36118 req_id = 1ff4bed4-7fa4-4ccd-94db-964528a37151 response_code = 204 uri = /config
722026-04-10T03:14:53.453ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:43272
732026-04-10T03:14:53.455ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 2c581992-b3c2-4eeb-8ec4-27aea8082208
742026-04-10T03:14:53.455ZINFOdns-server (store): updated generation new_generation = 1 req_id = 2c581992-b3c2-4eeb-8ec4-27aea8082208
752026-04-10T03:14:53.455ZINFOdns-server (http): request completed latency_us = 285 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:43272 req_id = 2c581992-b3c2-4eeb-8ec4-27aea8082208 response_code = 204 uri = /config
762026-04-10T03:14:53.932ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54531, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:27738 req_id = 211b8473-8be7-4e6b-8bb6-23b1c6eb30a5
772026-04-10T03:14:54.031ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:65520
782026-04-10T03:14:54.031ZINFOdns-server (http): request completed latency_us = 194 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:65520 req_id = bfb1595e-df9d-4d25-a74d-905c152c8d48 response_code = 200 uri = /config
792026-04-10T03:14:54.038ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40753, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:13306 req_id = f2d99b42-f06f-42ee-a3d9-aae7273b2fea
802026-04-10T03:14:54.137ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:52095
812026-04-10T03:14:54.137ZINFOdns-server (http): request completed latency_us = 183 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:52095 req_id = ff91c99d-bce4-4721-a049-9f1908975d1c response_code = 200 uri = /config
822026-04-10T03:14:54.230ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24791, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:49078 req_id = 49095203-16b5-4ecd-8bc6-be680853e5b8
832026-04-10T03:14:54.323ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:56904
842026-04-10T03:14:54.323ZINFOdns-server (http): request completed latency_us = 204 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:56904 req_id = 8aa1baf4-27e6-4289-a053-ce616a0a19bc response_code = 200 uri = /config
852026-04-10T03:14:54.580ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46171, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56018 req_id = 30b39fab-6efa-4e6d-83e9-c1f42bd8c17e
862026-04-10T03:15:00.156ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59379, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), ), original: Query { name: Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 52, 51, 54, 50, 54, 102, 54, 45, 98, 102, 98, 99, 45, 52, 55, 52, 50, 45, 57, 99, 52, 56, 45, 49, 55, 102, 49, 52, 101, 54, 49, 51, 98, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68." peer_addr = [fd00:1122:3344:101::e]:47996 req_id = c60f5ef7-fa54-45cd-8827-cb51723b91d1
872026-04-10T03:15:00.157ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59379, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), ), original: Query { name: Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 52, 51, 54, 50, 54, 102, 54, 45, 98, 102, 98, 99, 45, 52, 55, 52, 50, 45, 57, 99, 52, 56, 45, 49, 55, 102, 49, 52, 101, 54, 49, 51, 98, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68." peer_addr = [fd00:1122:3344:101::e]:64502 req_id = 54885f63-4b68-4b2d-b14d-180194f158fd
882026-04-10T03:15:00.800ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4903, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_39112fc7-8025-4b5f-b87d-6c88d324f549."), ), original: Query { name: Name("oxz_ntp_39112fc7-8025-4b5f-b87d-6c88d324f549."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 51, 57, 49, 49, 50, 102, 99, 55, 45, 56, 48, 50, 53, 45, 52, 98, 53, 102, 45, 98, 56, 55, 100, 45, 54, 99, 56, 56, 100, 51, 50, 52, 102, 53, 52, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_39112fc7-8025-4b5f-b87d-6c88d324f549." peer_addr = [fd00:1122:3344:101::1b]:51978 req_id = ae22da73-d416-4f8e-822d-30ad8e5c5d1b
892026-04-10T03:15:00.930ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39687, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca."), ), original: Query { name: Name("oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 51, 51, 51, 50, 52, 55, 53, 45, 49, 97, 55, 53, 45, 52, 98, 53, 55, 45, 57, 57, 52, 50, 45, 48, 100, 50, 56, 50, 48, 50, 97, 53, 48, 99, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca." peer_addr = [fd00:1122:3344:101::3]:63097 req_id = 261f0f64-c7a8-4a10-bbc0-02281cb95cd5
902026-04-10T03:15:00.930ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39687, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca."), ), original: Query { name: Name("oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 51, 51, 51, 50, 52, 55, 53, 45, 49, 97, 55, 53, 45, 52, 98, 53, 55, 45, 57, 57, 52, 50, 45, 48, 100, 50, 56, 50, 48, 50, 97, 53, 48, 99, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca." peer_addr = [fd00:1122:3344:101::3]:53052 req_id = 9512bd7f-b5e3-4bb3-a9f4-24ba259a45fd
912026-04-10T03:15:00.932ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20678, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9."), ), original: Query { name: Name("oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 100, 50, 51, 101, 53, 99, 54, 45, 102, 52, 99, 48, 45, 52, 50, 52, 54, 45, 56, 51, 97, 97, 45, 97, 53, 49, 52, 57, 48, 51, 54, 54, 56, 101, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9." peer_addr = [fd00:1122:3344:101::5]:48181 req_id = 434d02a8-4e8f-406f-bd58-ae171cb83b07
922026-04-10T03:15:00.932ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20678, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9."), ), original: Query { name: Name("oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 100, 50, 51, 101, 53, 99, 54, 45, 102, 52, 99, 48, 45, 52, 50, 52, 54, 45, 56, 51, 97, 97, 45, 97, 53, 49, 52, 57, 48, 51, 54, 54, 56, 101, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9." peer_addr = [fd00:1122:3344:101::5]:59999 req_id = 46094b67-051f-46aa-aa78-a2b253dd06e0
932026-04-10T03:15:00.958ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4357, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2."), ), original: Query { name: Name("oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 53, 48, 97, 99, 57, 57, 54, 45, 97, 100, 48, 57, 45, 52, 57, 55, 57, 45, 57, 97, 51, 101, 45, 57, 100, 51, 101, 57, 57, 100, 49, 54, 48, 101, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2." peer_addr = [fd00:1122:3344:101::7]:49412 req_id = f37c1bd9-36c1-470e-a4f9-0e1dc4d9c23b
942026-04-10T03:15:00.959ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4357, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2."), ), original: Query { name: Name("oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 53, 48, 97, 99, 57, 57, 54, 45, 97, 100, 48, 57, 45, 52, 57, 55, 57, 45, 57, 97, 51, 101, 45, 57, 100, 51, 101, 57, 57, 100, 49, 54, 48, 101, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2." peer_addr = [fd00:1122:3344:101::7]:46236 req_id = 98e70b1d-d033-4401-8aa3-e172bc6bf311
952026-04-10T03:15:00.969ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47263, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee."), ), original: Query { name: Name("oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 100, 49, 50, 99, 51, 54, 101, 45, 98, 98, 57, 54, 45, 52, 99, 102, 49, 45, 56, 50, 97, 98, 45, 57, 52, 50, 101, 49, 99, 55, 102, 52, 54, 101, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee." peer_addr = [fd00:1122:3344:101::4]:50024 req_id = ff8e97b3-8810-4012-bf22-b44ce65896e4
962026-04-10T03:15:00.970ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47263, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee."), ), original: Query { name: Name("oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 100, 49, 50, 99, 51, 54, 101, 45, 98, 98, 57, 54, 45, 52, 99, 102, 49, 45, 56, 50, 97, 98, 45, 57, 52, 50, 101, 49, 99, 55, 102, 52, 54, 101, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee." peer_addr = [fd00:1122:3344:101::4]:47493 req_id = 1975def5-24e0-4f61-89bd-e6faeec178cc
972026-04-10T03:15:00.973ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54518, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd."), ), original: Query { name: Name("oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 55, 101, 98, 55, 55, 102, 99, 45, 57, 55, 101, 102, 45, 52, 56, 52, 48, 45, 57, 53, 99, 51, 45, 102, 101, 55, 54, 53, 51, 53, 56, 51, 57, 100, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd." peer_addr = [fd00:1122:3344:101::6]:54555 req_id = 6917513a-c0f7-40da-99a9-2d97a8ef88f3
982026-04-10T03:15:00.974ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54518, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd."), ), original: Query { name: Name("oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 55, 101, 98, 55, 55, 102, 99, 45, 57, 55, 101, 102, 45, 52, 56, 52, 48, 45, 57, 53, 99, 51, 45, 102, 101, 55, 54, 53, 51, 53, 56, 51, 57, 100, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd." peer_addr = [fd00:1122:3344:101::6]:64560 req_id = 9b5a36a1-804f-4fa3-b5be-8587f7f6708b
992026-04-10T03:15:01.262ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39376, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:64641 req_id = ab7b9010-7d29-4cd8-bdb8-12ce04d41829
1002026-04-10T03:15:01.262ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39376, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:56649 req_id = f689fd3b-4e29-4833-ac4a-39d7000dda86