Max level shown:
1 [ Apr 24 17:27:38 Enabled. ]
2 [ Apr 24 17:27:38 Rereading configuration. ]
3 [ Apr 24 17:27:39 Rereading configuration. ]
4 [ Apr 24 17:27:40 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ Apr 24 17:27:40 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-04-24T17:27:40.756ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-04-24T17:27:40.756ZINFOdns-server (store): opening sled database path = /data/dns
102026-04-24T17:27:40.780ZINFOdns-server (store): pruning trees for generations newer than 0
112026-04-24T17:27:40.780ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-04-24T17:27:40.780ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-04-24T17:27:40.780ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-04-24T17:27:40.962ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:36972
152026-04-24T17:27:40.963ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = bd85e0c1-d4db-4672-9c04-9d73ef9d1a06
162026-04-24T17:27:40.963ZINFOdns-server (store): pruning trees for generations newer than 0
172026-04-24T17:27:40.988ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-04-24T17:27:40.988ZINFOdns-server (store): updated generation new_generation = 1 req_id = bd85e0c1-d4db-4672-9c04-9d73ef9d1a06
192026-04-24T17:27:40.988ZINFOdns-server (http): request completed latency_us = 25900 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:36972 req_id = bd85e0c1-d4db-4672-9c04-9d73ef9d1a06 response_code = 204 uri = /config
202026-04-24T17:27:52.350ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64889, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:48463 req_id = 83539558-3db2-4572-b573-2edb14111335
212026-04-24T17:27:52.355ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46340, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:47565 req_id = fefa7af6-f528-4c31-ae9a-e2474a854524
222026-04-24T17:27:52.361ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20532, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:50329 req_id = fff5ddf5-02a0-49ff-ae59-8005ae681d8b
232026-04-24T17:29:24.842ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1574, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53432 req_id = 4c2d5c21-759e-4647-8ef9-cb9ebcef1831
242026-04-24T17:29:27.606ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29812, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a."), ), original: Query { name: Name("oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 97, 99, 99, 55, 55, 51, 49, 45, 101, 99, 52, 51, 45, 52, 53, 54, 55, 45, 98, 49, 53, 52, 45, 100, 48, 97, 54, 100, 102, 99, 97, 51, 49, 55, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a." peer_addr = [fd00:1122:3344:101::e]:33150 req_id = 9afb33af-10b0-4f67-b8eb-a1ac73739bd9
252026-04-24T17:29:27.616ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29812, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a."), ), original: Query { name: Name("oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 97, 99, 99, 55, 55, 51, 49, 45, 101, 99, 52, 51, 45, 52, 53, 54, 55, 45, 98, 49, 53, 52, 45, 100, 48, 97, 54, 100, 102, 99, 97, 51, 49, 55, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a." peer_addr = [fd00:1122:3344:101::e]:47634 req_id = 9f536f4e-e822-44a2-b5ea-8b0d6c01cb54
262026-04-24T17:29:28.485ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39820, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:56308 req_id = a8abcf90-df55-423a-81a0-3f7d572b1f0b
272026-04-24T17:29:28.490ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25844, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:33089 req_id = 342a6b2d-3392-425a-9faa-77b3d4d7d2cc
282026-04-24T17:29:28.494ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9038, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:51359 req_id = 46a501a2-0190-4cf5-918c-bb15f5a9b51e
292026-04-24T17:29:34.820ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26857, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:61272 req_id = 55fb294e-a59a-4d04-b18d-d87a63471f96
302026-04-24T17:29:35.109ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50011, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:54441 req_id = d16f2456-1006-4d96-a32b-a3c2c5c44c82
312026-04-24T17:29:35.109ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22843, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:35234 req_id = 1062817f-573c-4220-a293-bd77a3b33075
322026-04-24T17:29:35.325ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8866, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:7135 req_id = 12a7beef-f813-4d84-805a-74534ada2df3
332026-04-24T17:29:44.821ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61240, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:53640 req_id = 3ae20c40-54a4-428a-a7fd-90f00bd74a3a
342026-04-24T17:29:52.496ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54245, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:44389 req_id = 4490276e-62fd-439c-a006-f2539e157e59
352026-04-24T17:29:52.504ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26733, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:53260 req_id = b5bca3c3-1b7e-40a3-b32d-a21777084388
362026-04-24T17:29:52.508ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36407, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:40976 req_id = 5037fe60-dcb0-434d-aecd-67e4fc500f35
372026-04-24T17:29:54.827ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31016, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59911 req_id = bc06405b-4227-4fb4-8a90-d3e672e34e1d
382026-04-24T17:30:00.224ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52231, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_4d74a89f-e104-40b5-8baf-e3e22337547d."), ), original: Query { name: Name("oxz_cockroachdb_4d74a89f-e104-40b5-8baf-e3e22337547d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 100, 55, 52, 97, 56, 57, 102, 45, 101, 49, 48, 52, 45, 52, 48, 98, 53, 45, 56, 98, 97, 102, 45, 101, 51, 101, 50, 50, 51, 51, 55, 53, 52, 55, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_4d74a89f-e104-40b5-8baf-e3e22337547d." peer_addr = [fd00:1122:3344:101::4]:35856 req_id = 62aeeeb0-6b8d-435e-8595-413c5922ab84
392026-04-24T17:30:00.224ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52231, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_4d74a89f-e104-40b5-8baf-e3e22337547d."), ), original: Query { name: Name("oxz_cockroachdb_4d74a89f-e104-40b5-8baf-e3e22337547d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 100, 55, 52, 97, 56, 57, 102, 45, 101, 49, 48, 52, 45, 52, 48, 98, 53, 45, 56, 98, 97, 102, 45, 101, 51, 101, 50, 50, 51, 51, 55, 53, 52, 55, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_4d74a89f-e104-40b5-8baf-e3e22337547d." peer_addr = [fd00:1122:3344:101::4]:55942 req_id = d5d2c38d-94c2-4e54-af18-2462c372e19e
402026-04-24T17:30:00.244ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6683, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f0073fce-1841-4415-9738-0197395ec3c7."), ), original: Query { name: Name("oxz_cockroachdb_f0073fce-1841-4415-9738-0197395ec3c7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 48, 48, 55, 51, 102, 99, 101, 45, 49, 56, 52, 49, 45, 52, 52, 49, 53, 45, 57, 55, 51, 56, 45, 48, 49, 57, 55, 51, 57, 53, 101, 99, 51, 99, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f0073fce-1841-4415-9738-0197395ec3c7." peer_addr = [fd00:1122:3344:101::5]:55665 req_id = fe55dd4f-fadb-415d-a2e5-0d213147d0b9
412026-04-24T17:30:00.245ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6683, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f0073fce-1841-4415-9738-0197395ec3c7."), ), original: Query { name: Name("oxz_cockroachdb_f0073fce-1841-4415-9738-0197395ec3c7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 48, 48, 55, 51, 102, 99, 101, 45, 49, 56, 52, 49, 45, 52, 52, 49, 53, 45, 57, 55, 51, 56, 45, 48, 49, 57, 55, 51, 57, 53, 101, 99, 51, 99, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f0073fce-1841-4415-9738-0197395ec3c7." peer_addr = [fd00:1122:3344:101::5]:34573 req_id = 8c60390d-f298-4adf-a0a7-573f340dee53
422026-04-24T17:30:00.271ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14818, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_bd843736-59fd-4dc1-ae84-810763560162."), ), original: Query { name: Name("oxz_cockroachdb_bd843736-59fd-4dc1-ae84-810763560162."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 100, 56, 52, 51, 55, 51, 54, 45, 53, 57, 102, 100, 45, 52, 100, 99, 49, 45, 97, 101, 56, 52, 45, 56, 49, 48, 55, 54, 51, 53, 54, 48, 49, 54, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_bd843736-59fd-4dc1-ae84-810763560162." peer_addr = [fd00:1122:3344:101::7]:51550 req_id = 1a330b7d-a05d-4bff-8e6c-98d5e3f19b26
432026-04-24T17:30:00.271ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14818, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_bd843736-59fd-4dc1-ae84-810763560162."), ), original: Query { name: Name("oxz_cockroachdb_bd843736-59fd-4dc1-ae84-810763560162."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 100, 56, 52, 51, 55, 51, 54, 45, 53, 57, 102, 100, 45, 52, 100, 99, 49, 45, 97, 101, 56, 52, 45, 56, 49, 48, 55, 54, 51, 53, 54, 48, 49, 54, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_bd843736-59fd-4dc1-ae84-810763560162." peer_addr = [fd00:1122:3344:101::7]:59216 req_id = 2db28022-09cb-444f-8067-25c00044297c
442026-04-24T17:30:00.309ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12546, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_08362669-be09-4591-b1f3-b5c2f6bcbcb7."), ), original: Query { name: Name("oxz_cockroachdb_08362669-be09-4591-b1f3-b5c2f6bcbcb7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 56, 51, 54, 50, 54, 54, 57, 45, 98, 101, 48, 57, 45, 52, 53, 57, 49, 45, 98, 49, 102, 51, 45, 98, 53, 99, 50, 102, 54, 98, 99, 98, 99, 98, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_08362669-be09-4591-b1f3-b5c2f6bcbcb7." peer_addr = [fd00:1122:3344:101::6]:54199 req_id = 5f9f9a6f-5ba0-48e6-8fd3-578390235928
452026-04-24T17:30:00.310ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12546, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_08362669-be09-4591-b1f3-b5c2f6bcbcb7."), ), original: Query { name: Name("oxz_cockroachdb_08362669-be09-4591-b1f3-b5c2f6bcbcb7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 56, 51, 54, 50, 54, 54, 57, 45, 98, 101, 48, 57, 45, 52, 53, 57, 49, 45, 98, 49, 102, 51, 45, 98, 53, 99, 50, 102, 54, 98, 99, 98, 99, 98, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_08362669-be09-4591-b1f3-b5c2f6bcbcb7." peer_addr = [fd00:1122:3344:101::6]:59757 req_id = cf0d368e-b098-478f-abb3-bc52d419e751
462026-04-24T17:30:00.356ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36156, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f320c894-7b4d-4563-84fb-ff8da32f031d."), ), original: Query { name: Name("oxz_cockroachdb_f320c894-7b4d-4563-84fb-ff8da32f031d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 51, 50, 48, 99, 56, 57, 52, 45, 55, 98, 52, 100, 45, 52, 53, 54, 51, 45, 56, 52, 102, 98, 45, 102, 102, 56, 100, 97, 51, 50, 102, 48, 51, 49, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f320c894-7b4d-4563-84fb-ff8da32f031d." peer_addr = [fd00:1122:3344:101::3]:59540 req_id = 73507278-ac21-4a55-bf4d-35369631368c
472026-04-24T17:30:00.356ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36156, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f320c894-7b4d-4563-84fb-ff8da32f031d."), ), original: Query { name: Name("oxz_cockroachdb_f320c894-7b4d-4563-84fb-ff8da32f031d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 51, 50, 48, 99, 56, 57, 52, 45, 55, 98, 52, 100, 45, 52, 53, 54, 51, 45, 56, 52, 102, 98, 45, 102, 102, 56, 100, 97, 51, 50, 102, 48, 51, 49, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f320c894-7b4d-4563-84fb-ff8da32f031d." peer_addr = [fd00:1122:3344:101::3]:43598 req_id = 9db9a6ab-0f47-4557-a50f-c0c2f0c209a2
482026-04-24T17:30:00.455ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 65248, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_8b295a36-c931-4d17-9e48-887898bfd60b."), ), original: Query { name: Name("oxz_ntp_8b295a36-c931-4d17-9e48-887898bfd60b."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 56, 98, 50, 57, 53, 97, 51, 54, 45, 99, 57, 51, 49, 45, 52, 100, 49, 55, 45, 57, 101, 52, 56, 45, 56, 56, 55, 56, 57, 56, 98, 102, 100, 54, 48, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_8b295a36-c931-4d17-9e48-887898bfd60b." peer_addr = [fd00:1122:3344:101::1b]:57034 req_id = 1253553a-f71b-4e44-b13a-b4668f5a120c
492026-04-24T17:30:00.575ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25953, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a."), ), original: Query { name: Name("oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 97, 99, 99, 55, 55, 51, 49, 45, 101, 99, 52, 51, 45, 52, 53, 54, 55, 45, 98, 49, 53, 52, 45, 100, 48, 97, 54, 100, 102, 99, 97, 51, 49, 55, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a." peer_addr = [fd00:1122:3344:101::e]:57425 req_id = 6af57b2b-ff86-4eac-806d-4c239e1c2ce4
502026-04-24T17:30:00.575ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25953, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a."), ), original: Query { name: Name("oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 97, 99, 99, 55, 55, 51, 49, 45, 101, 99, 52, 51, 45, 52, 53, 54, 55, 45, 98, 49, 53, 52, 45, 100, 48, 97, 54, 100, 102, 99, 97, 51, 49, 55, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_9acc7731-ec43-4567-b154-d0a6dfca317a." peer_addr = [fd00:1122:3344:101::e]:61644 req_id = e9679965-1418-495f-8672-4a1cf9639271
512026-04-24T17:30:00.578ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46218, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:65400 req_id = aca1d27c-ad24-41c2-9738-c3a49d6ce4a6
522026-04-24T17:30:00.579ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46218, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:51964 req_id = d830bf97-849c-4b5c-8de2-7888f2fad1ff
532026-04-24T17:30:00.898ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6093, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:17501 req_id = bbce44c1-04ba-4458-a270-2f3281820445
542026-04-24T17:30:01.260ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:55745
552026-04-24T17:30:01.336ZINFOdns-server (http): request completed latency_us = 50427 local_addr = [fd00:1122:3344:2::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:55745 req_id = 6928e87a-db8e-4ae4-afc1-a2822342c0b5 response_code = 200 uri = /config
562026-04-24T17:30:02.263ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54631, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:47823 req_id = 1b5cde3e-8222-4f98-94ed-cd36d599450b
572026-04-24T17:30:02.309ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:101::c]:55043
582026-04-24T17:30:02.311ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3561fdac-b00b-4f7a-a1ce-91e0abd0cf66
592026-04-24T17:30:02.311ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3561fdac-b00b-4f7a-a1ce-91e0abd0cf66
602026-04-24T17:30:02.311ZINFOdns-server (http): request completed latency_us = 343 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:55043 req_id = 3561fdac-b00b-4f7a-a1ce-91e0abd0cf66 response_code = 204 uri = /config