Max level shown:
1 [ May 8 13:56:35 Enabled. ]
2 [ May 8 13:56:35 Rereading configuration. ]
3 [ May 8 13:56:36 Rereading configuration. ]
4 [ May 8 13:56:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ May 8 13:56:37 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-05-08T13:56:37.634ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-05-08T13:56:37.634ZINFOdns-server (store): opening sled database path = /data/dns
102026-05-08T13:56:37.654ZINFOdns-server (store): pruning trees for generations newer than 0
112026-05-08T13:56:37.654ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-05-08T13:56:37.654ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-05-08T13:56:37.655ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-05-08T13:56:37.828ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:47559
152026-05-08T13:56:37.829ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a597bfcd-38b5-426a-9676-da59eaad9407
162026-05-08T13:56:37.829ZINFOdns-server (store): pruning trees for generations newer than 0
172026-05-08T13:56:37.858ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-05-08T13:56:37.858ZINFOdns-server (store): updated generation new_generation = 1 req_id = a597bfcd-38b5-426a-9676-da59eaad9407
192026-05-08T13:56:37.858ZINFOdns-server (http): request completed latency_us = 29342 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:47559 req_id = a597bfcd-38b5-426a-9676-da59eaad9407 response_code = 204 uri = /config
202026-05-08T13:56:48.808ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:34771 req_id = c19ed262-aa6d-48f7-b8ef-da697a5d4ac3
212026-05-08T13:56:48.812ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38074, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:55244 req_id = 7c043590-2610-4fa0-9058-bb01bea4d266
222026-05-08T13:56:48.816ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13050, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:40477 req_id = ac3d0bd8-ca9a-403c-8ff7-0771356fdd53
232026-05-08T13:58:49.564ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30685, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:34341 req_id = 58514d4c-c8d4-468e-a5b9-a1c679cd223e
242026-05-08T13:58:49.597ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54165, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:58836 req_id = fe6b1b19-ae00-4a0c-83f9-4875b228ecfe
252026-05-08T13:58:49.597ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63262, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:43632 req_id = ca55aa18-2cec-4f00-9eec-05d885fd0822
262026-05-08T13:59:18.858ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30680, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:64720 req_id = 7de0c632-2265-494d-8383-1ffd6ba5c7f6
272026-05-08T13:59:22.179ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 242, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770."), ), original: Query { name: Name("oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 99, 55, 55, 57, 49, 100, 50, 45, 97, 98, 98, 49, 45, 52, 54, 49, 99, 45, 97, 99, 49, 50, 45, 49, 51, 49, 55, 52, 48, 53, 57, 55, 55, 55, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770." peer_addr = [fd00:1122:3344:101::e]:43870 req_id = e2bd23a8-95a3-4098-89b5-81adf2cfd64e
282026-05-08T13:59:22.180ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 242, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770."), ), original: Query { name: Name("oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 99, 55, 55, 57, 49, 100, 50, 45, 97, 98, 98, 49, 45, 52, 54, 49, 99, 45, 97, 99, 49, 50, 45, 49, 51, 49, 55, 52, 48, 53, 57, 55, 55, 55, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770." peer_addr = [fd00:1122:3344:101::e]:51221 req_id = a965371c-86fa-4b3c-8aff-2d8bbce58c1c
292026-05-08T13:59:27.223ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52278, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:15728 req_id = f8835af1-d1d2-4bb2-9d6e-4521824b37aa
302026-05-08T13:59:27.346ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47940, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:62859 req_id = 788a70df-f9a6-4077-a605-8760d3708b0e
312026-05-08T13:59:27.347ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56824, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:32145 req_id = 66581c24-c382-41cf-b256-b3e4016857c8
322026-05-08T13:59:28.859ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12150, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:56704 req_id = cf0e9a9a-3528-498c-8192-59686059a786
332026-05-08T13:59:38.861ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62070, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:63215 req_id = e0d0db4f-bdc4-4563-a059-a4367f7ef6d5
342026-05-08T13:59:48.862ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2687, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:58336 req_id = 11da8054-794d-4bc8-a796-13f091d1b4c9
352026-05-08T13:59:57.416ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2421, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:15771 req_id = 80f64ff3-5d68-4679-8f90-0c5ec528b97c
362026-05-08T13:59:57.877ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:37095
372026-05-08T13:59:57.949ZINFOdns-server (http): request completed latency_us = 40561 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:37095 req_id = cdc9bbdd-199d-45de-b25b-8e61231458c1 response_code = 200 uri = /config
382026-05-08T13:59:58.864ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59009, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59151 req_id = a41ee7ee-2258-4ae0-b7df-f196289fbec9
392026-05-08T14:00:00.301ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18855, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_0916494c-4fce-4f26-a5d2-e25dcc3a847e."), ), original: Query { name: Name("oxz_cockroachdb_0916494c-4fce-4f26-a5d2-e25dcc3a847e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 57, 49, 54, 52, 57, 52, 99, 45, 52, 102, 99, 101, 45, 52, 102, 50, 54, 45, 97, 53, 100, 50, 45, 101, 50, 53, 100, 99, 99, 51, 97, 56, 52, 55, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0916494c-4fce-4f26-a5d2-e25dcc3a847e." peer_addr = [fd00:1122:3344:101::7]:34809 req_id = 403a0fc1-32a4-48ba-a39c-e32569c5b8ee
402026-05-08T14:00:00.302ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18855, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_0916494c-4fce-4f26-a5d2-e25dcc3a847e."), ), original: Query { name: Name("oxz_cockroachdb_0916494c-4fce-4f26-a5d2-e25dcc3a847e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 57, 49, 54, 52, 57, 52, 99, 45, 52, 102, 99, 101, 45, 52, 102, 50, 54, 45, 97, 53, 100, 50, 45, 101, 50, 53, 100, 99, 99, 51, 97, 56, 52, 55, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0916494c-4fce-4f26-a5d2-e25dcc3a847e." peer_addr = [fd00:1122:3344:101::7]:47303 req_id = 9ff3044a-1010-462e-9f6c-94dc3c451db0
412026-05-08T14:00:00.305ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47486, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_305baf46-1073-42fb-9004-551274f797fb."), ), original: Query { name: Name("oxz_cockroachdb_305baf46-1073-42fb-9004-551274f797fb."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 48, 53, 98, 97, 102, 52, 54, 45, 49, 48, 55, 51, 45, 52, 50, 102, 98, 45, 57, 48, 48, 52, 45, 53, 53, 49, 50, 55, 52, 102, 55, 57, 55, 102, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_305baf46-1073-42fb-9004-551274f797fb." peer_addr = [fd00:1122:3344:101::3]:65310 req_id = e80655b3-a2f7-4e19-a01a-3c295e664358
422026-05-08T14:00:00.305ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47486, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_305baf46-1073-42fb-9004-551274f797fb."), ), original: Query { name: Name("oxz_cockroachdb_305baf46-1073-42fb-9004-551274f797fb."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 48, 53, 98, 97, 102, 52, 54, 45, 49, 48, 55, 51, 45, 52, 50, 102, 98, 45, 57, 48, 48, 52, 45, 53, 53, 49, 50, 55, 52, 102, 55, 57, 55, 102, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_305baf46-1073-42fb-9004-551274f797fb." peer_addr = [fd00:1122:3344:101::3]:43244 req_id = 75b187c5-56f2-446d-9ea0-c15c337ba3d7
432026-05-08T14:00:00.324ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28128, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8fcd7158-78b6-488c-8477-478ad102837c."), ), original: Query { name: Name("oxz_cockroachdb_8fcd7158-78b6-488c-8477-478ad102837c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 102, 99, 100, 55, 49, 53, 56, 45, 55, 56, 98, 54, 45, 52, 56, 56, 99, 45, 56, 52, 55, 55, 45, 52, 55, 56, 97, 100, 49, 48, 50, 56, 51, 55, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8fcd7158-78b6-488c-8477-478ad102837c." peer_addr = [fd00:1122:3344:101::5]:32825 req_id = 4444447e-d000-4be8-b33d-3557eff2acff
442026-05-08T14:00:00.324ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28128, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8fcd7158-78b6-488c-8477-478ad102837c."), ), original: Query { name: Name("oxz_cockroachdb_8fcd7158-78b6-488c-8477-478ad102837c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 102, 99, 100, 55, 49, 53, 56, 45, 55, 56, 98, 54, 45, 52, 56, 56, 99, 45, 56, 52, 55, 55, 45, 52, 55, 56, 97, 100, 49, 48, 50, 56, 51, 55, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8fcd7158-78b6-488c-8477-478ad102837c." peer_addr = [fd00:1122:3344:101::5]:61863 req_id = b6f41ca3-8008-447d-ad0f-9c67cf8f88fb
452026-05-08T14:00:00.334ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60125, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_20612c8d-cb3e-4ac1-81bc-b9c868243355."), ), original: Query { name: Name("oxz_cockroachdb_20612c8d-cb3e-4ac1-81bc-b9c868243355."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 48, 54, 49, 50, 99, 56, 100, 45, 99, 98, 51, 101, 45, 52, 97, 99, 49, 45, 56, 49, 98, 99, 45, 98, 57, 99, 56, 54, 56, 50, 52, 51, 51, 53, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_20612c8d-cb3e-4ac1-81bc-b9c868243355." peer_addr = [fd00:1122:3344:101::4]:46023 req_id = 36c93e51-e6e4-4b69-bdd6-09ea01644475
462026-05-08T14:00:00.335ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60125, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_20612c8d-cb3e-4ac1-81bc-b9c868243355."), ), original: Query { name: Name("oxz_cockroachdb_20612c8d-cb3e-4ac1-81bc-b9c868243355."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 48, 54, 49, 50, 99, 56, 100, 45, 99, 98, 51, 101, 45, 52, 97, 99, 49, 45, 56, 49, 98, 99, 45, 98, 57, 99, 56, 54, 56, 50, 52, 51, 51, 53, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_20612c8d-cb3e-4ac1-81bc-b9c868243355." peer_addr = [fd00:1122:3344:101::4]:55446 req_id = f64a0750-e2db-4119-a60b-eca6f8beb150
472026-05-08T14:00:00.338ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2092, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5fe707d1-5e3d-42b3-b038-5706f7c436ee."), ), original: Query { name: Name("oxz_cockroachdb_5fe707d1-5e3d-42b3-b038-5706f7c436ee."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 102, 101, 55, 48, 55, 100, 49, 45, 53, 101, 51, 100, 45, 52, 50, 98, 51, 45, 98, 48, 51, 56, 45, 53, 55, 48, 54, 102, 55, 99, 52, 51, 54, 101, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5fe707d1-5e3d-42b3-b038-5706f7c436ee." peer_addr = [fd00:1122:3344:101::6]:33072 req_id = 7c0e83dc-2db3-44d7-a19a-06adcbfdb8a9
482026-05-08T14:00:00.339ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2092, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5fe707d1-5e3d-42b3-b038-5706f7c436ee."), ), original: Query { name: Name("oxz_cockroachdb_5fe707d1-5e3d-42b3-b038-5706f7c436ee."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 102, 101, 55, 48, 55, 100, 49, 45, 53, 101, 51, 100, 45, 52, 50, 98, 51, 45, 98, 48, 51, 56, 45, 53, 55, 48, 54, 102, 55, 99, 52, 51, 54, 101, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5fe707d1-5e3d-42b3-b038-5706f7c436ee." peer_addr = [fd00:1122:3344:101::6]:44546 req_id = dfa310a3-4c71-41b1-9809-9c04ae2a7eb1
492026-05-08T14:00:00.786ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16232, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:48759 req_id = 029d0cf6-1500-4cc6-9a1d-ff17f388a414
502026-05-08T14:00:00.787ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16232, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:54942 req_id = e685a155-0ebd-4696-a470-4b4bf1c066bb
512026-05-08T14:00:00.822ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50407, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770."), ), original: Query { name: Name("oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 99, 55, 55, 57, 49, 100, 50, 45, 97, 98, 98, 49, 45, 52, 54, 49, 99, 45, 97, 99, 49, 50, 45, 49, 51, 49, 55, 52, 48, 53, 57, 55, 55, 55, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770." peer_addr = [fd00:1122:3344:101::e]:49869 req_id = b4003071-d31a-4abe-8e23-327a0a794c6c
522026-05-08T14:00:00.823ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 50407, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770."), ), original: Query { name: Name("oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 99, 55, 55, 57, 49, 100, 50, 45, 97, 98, 98, 49, 45, 52, 54, 49, 99, 45, 97, 99, 49, 50, 45, 49, 51, 49, 55, 52, 48, 53, 57, 55, 55, 55, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_7c7791d2-abb1-461c-ac12-131740597770." peer_addr = [fd00:1122:3344:101::e]:52231 req_id = 6cf5e0c1-3fd2-4e3a-885d-03048293059d
532026-05-08T14:00:00.840ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 65369, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_6b1d49a4-4cfc-482f-9b43-a852b5fc2148."), ), original: Query { name: Name("oxz_ntp_6b1d49a4-4cfc-482f-9b43-a852b5fc2148."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 54, 98, 49, 100, 52, 57, 97, 52, 45, 52, 99, 102, 99, 45, 52, 56, 50, 102, 45, 57, 98, 52, 51, 45, 97, 56, 53, 50, 98, 53, 102, 99, 50, 49, 52, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_6b1d49a4-4cfc-482f-9b43-a852b5fc2148." peer_addr = [fd00:1122:3344:101::1b]:62510 req_id = 425b0c78-8c74-40b9-a4d3-61eb6a2bdf51
542026-05-08T14:00:02.297ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:59398
552026-05-08T14:00:02.298ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 0b74c080-5a6e-46f1-9e09-ef161af35da7
562026-05-08T14:00:02.298ZINFOdns-server (store): updated generation new_generation = 1 req_id = 0b74c080-5a6e-46f1-9e09-ef161af35da7
572026-05-08T14:00:02.298ZINFOdns-server (http): request completed latency_us = 245 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:59398 req_id = 0b74c080-5a6e-46f1-9e09-ef161af35da7 response_code = 204 uri = /config
582026-05-08T14:00:02.315ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61681, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:17334 req_id = 577870b9-0d21-4c5d-90ac-10a64546fb5b
592026-05-08T14:00:02.646ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:51407
602026-05-08T14:00:02.647ZINFOdns-server (http): request completed latency_us = 213 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:51407 req_id = df838c96-cc60-46a9-9ea4-32cac2e901af response_code = 200 uri = /config