Max level shown:
1 [ Apr 10 03:10:08 Enabled. ]
2 [ Apr 10 03:10:08 Rereading configuration. ]
3 [ Apr 10 03:10:09 Rereading configuration. ]
4 [ Apr 10 03:10:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:1::1]:5353 --dns-address [fd00:1122:3344:1::1]:53 &"). ]
5 [ Apr 10 03:10:10 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-04-10T03:10:10.965ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:1::1]:53 }
92026-04-10T03:10:10.965ZINFOdns-server (store): opening sled database path = /data/dns
102026-04-10T03:10:10.983ZINFOdns-server (store): pruning trees for generations newer than 0
112026-04-10T03:10:10.983ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-04-10T03:10:10.983ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:1::1]:53
132026-04-10T03:10:10.983ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:1::1]:5353
142026-04-10T03:10:11.345ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53565, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:1::2]:29053 req_id = 6230f50f-7bf2-432c-ba32-8872e8774fec
152026-04-10T03:10:11.378ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:1::2]:65429
162026-04-10T03:10:11.379ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3e7b5d17-18d3-43ec-83dd-da430a35aeee
172026-04-10T03:10:11.379ZINFOdns-server (store): pruning trees for generations newer than 0
182026-04-10T03:10:11.417ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
192026-04-10T03:10:11.417ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3e7b5d17-18d3-43ec-83dd-da430a35aeee
202026-04-10T03:10:11.417ZINFOdns-server (http): request completed latency_us = 38692 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:1::2]:65429 req_id = 3e7b5d17-18d3-43ec-83dd-da430a35aeee response_code = 204 uri = /config
212026-04-10T03:10:23.761ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57235, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:41400 req_id = 7572500a-1fcf-460c-9c4c-58e842cbafcf
222026-04-10T03:10:23.769ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17752, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35572 req_id = 751b08a4-8018-42a5-b097-35ce8ba083ba
232026-04-10T03:10:23.774ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54598, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:56529 req_id = 4bb2a931-d7c4-4fcf-8b62-1ffc83d05241
242026-04-10T03:11:48.402ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30478, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:53534 req_id = 8eb5732c-be6c-4452-9d78-41882987e43b
252026-04-10T03:11:48.407ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7615, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:58456 req_id = 546ecbab-ccee-404d-a157-30f937d21a69
262026-04-10T03:11:48.412ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43544, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59292 req_id = fb657560-5be9-4ddf-8e2d-85716ff8739d
272026-04-10T03:13:47.305ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43122, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), ), original: Query { name: Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 52, 51, 54, 50, 54, 102, 54, 45, 98, 102, 98, 99, 45, 52, 55, 52, 50, 45, 57, 99, 52, 56, 45, 49, 55, 102, 49, 52, 101, 54, 49, 51, 98, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68." peer_addr = [fd00:1122:3344:101::e]:49756 req_id = 210cf5b4-fa6e-41d5-8597-2c76de1092fa
282026-04-10T03:13:47.310ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43122, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), ), original: Query { name: Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 52, 51, 54, 50, 54, 102, 54, 45, 98, 102, 98, 99, 45, 52, 55, 52, 50, 45, 57, 99, 52, 56, 45, 49, 55, 102, 49, 52, 101, 54, 49, 51, 98, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68." peer_addr = [fd00:1122:3344:101::e]:48219 req_id = 8f842de2-d5cb-44c9-8a43-f91a9814ce35
292026-04-10T03:13:52.128ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41708, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:62407 req_id = eac2f053-90aa-4312-aca1-92efab43282f
302026-04-10T03:13:53.347ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52125, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:62395 req_id = 150fd08e-55fd-4fd5-bdd2-db7b3d21b1c4
312026-04-10T03:13:53.535ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38410, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:48528 req_id = 6f85cc3b-9efb-4bbc-8c6d-80d3e91b0fb9
322026-04-10T03:13:54.044ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:34146
332026-04-10T03:13:54.047ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:41956
342026-04-10T03:13:54.078ZINFOdns-server (http): request completed latency_us = 23448 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:34146 req_id = ab48d6a0-f1bb-416a-ae86-97947a9a98d0 response_code = 200 uri = /config
352026-04-10T03:13:54.078ZINFOdns-server (http): request completed latency_us = 23457 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:41956 req_id = bdd6e25f-0bfd-46aa-a493-993b25882541 response_code = 200 uri = /config
362026-04-10T03:13:54.149ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8723, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:15841 req_id = 59cb7db1-5eb9-4d85-b150-f8074cebf960
372026-04-10T03:13:54.271ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:47686
382026-04-10T03:13:54.271ZINFOdns-server (http): request completed latency_us = 222 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:47686 req_id = a3739d2f-2625-46b8-9ed9-077e186a74fb response_code = 200 uri = /config
392026-04-10T03:13:55.723ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51721, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:32274 req_id = 6c66c31c-bd89-4619-825d-1f3bced455fe
402026-04-10T03:13:55.768ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:58033
412026-04-10T03:13:55.773ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 211ad0d5-32f1-4369-9736-39741e0d6f10
422026-04-10T03:13:55.773ZINFOdns-server (store): updated generation new_generation = 1 req_id = 211ad0d5-32f1-4369-9736-39741e0d6f10
432026-04-10T03:13:55.773ZINFOdns-server (http): request completed latency_us = 2745 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:58033 req_id = 211ad0d5-32f1-4369-9736-39741e0d6f10 response_code = 204 uri = /config
442026-04-10T03:13:55.937ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:55966
452026-04-10T03:13:55.938ZINFOdns-server (http): request completed latency_us = 192 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:55966 req_id = c5f68122-3ae8-48ab-8b3c-ca55a033f619 response_code = 200 uri = /config
462026-04-10T03:13:56.556ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64561, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:29236 req_id = 9e9de8c1-fb28-439f-9f5c-55adca488fda
472026-04-10T03:13:56.668ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:38771
482026-04-10T03:13:56.669ZINFOdns-server (http): request completed latency_us = 188 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:38771 req_id = b9d9a326-aa7a-47ac-9c68-678ef8f6049e response_code = 200 uri = /config
492026-04-10T03:14:04.205ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53926, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:47729 req_id = 7b1e621e-3216-40bc-86ba-b51a43f23659
502026-04-10T03:14:04.205ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55743, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:44227 req_id = c3e643d8-a2c8-45f4-a55d-905829ca5289
512026-04-10T03:14:04.319ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:55802
522026-04-10T03:14:04.319ZINFOdns-server (http): request completed latency_us = 194 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:55802 req_id = 8453cfc0-f306-47df-96da-bee7edbb6693 response_code = 200 uri = /config
532026-04-10T03:14:04.374ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:51183
542026-04-10T03:14:04.375ZINFOdns-server (http): request completed latency_us = 184 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:51183 req_id = f5d487b7-3d4d-46ff-b60f-335e66d63a6f response_code = 200 uri = /config
552026-04-10T03:14:04.573ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22405, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57316 req_id = 46aa7eeb-7a6c-462e-b8da-d0b00173315a
562026-04-10T03:14:14.574ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 65282, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:62321 req_id = f6cd667b-a4ef-4779-b707-58c9d9af5eba
572026-04-10T03:14:16.418ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10438, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:52539 req_id = fc75bffd-e9a9-4d47-bf76-efb830d47718
582026-04-10T03:14:16.422ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6910, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35509 req_id = 1a6921fb-35d8-4ab3-93dd-81e501b80694
592026-04-10T03:14:16.427ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46725, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:43962 req_id = 251b94b7-b32f-4445-bd6e-61ecb7a5104b
602026-04-10T03:14:24.576ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1849, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54826 req_id = a40cd18a-7ed3-46aa-8f19-d07ee6e5d0c6
612026-04-10T03:14:34.577ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49286, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54035 req_id = 01806289-39b1-41de-b9e8-ed3cb7129b6b
622026-04-10T03:14:44.579ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13191, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:60829 req_id = afdbd279-ae9b-48b5-8c0b-28f83fac749b
632026-04-10T03:14:51.871ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:54144
642026-04-10T03:14:51.873ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e0dc4ec7-2609-44c9-93d4-89fc145e9a7f
652026-04-10T03:14:51.873ZINFOdns-server (store): updated generation new_generation = 1 req_id = e0dc4ec7-2609-44c9-93d4-89fc145e9a7f
662026-04-10T03:14:51.873ZINFOdns-server (http): request completed latency_us = 188 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:54144 req_id = e0dc4ec7-2609-44c9-93d4-89fc145e9a7f response_code = 204 uri = /config
672026-04-10T03:14:53.340ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:35426
682026-04-10T03:14:53.343ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 98a7014e-d8a2-4355-9758-faf6d271d7b4
692026-04-10T03:14:53.343ZINFOdns-server (store): updated generation new_generation = 1 req_id = 98a7014e-d8a2-4355-9758-faf6d271d7b4
702026-04-10T03:14:53.343ZINFOdns-server (http): request completed latency_us = 340 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:35426 req_id = 98a7014e-d8a2-4355-9758-faf6d271d7b4 response_code = 204 uri = /config
712026-04-10T03:14:53.452ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:51692
722026-04-10T03:14:53.454ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 960f4bb8-bfb0-4b2b-920e-80b0f548d64a
732026-04-10T03:14:53.455ZINFOdns-server (store): updated generation new_generation = 1 req_id = 960f4bb8-bfb0-4b2b-920e-80b0f548d64a
742026-04-10T03:14:53.455ZINFOdns-server (http): request completed latency_us = 313 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:51692 req_id = 960f4bb8-bfb0-4b2b-920e-80b0f548d64a response_code = 204 uri = /config
752026-04-10T03:14:53.932ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4763, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:39317 req_id = 5f8c0c38-9f11-443e-b22a-79db30555e08
762026-04-10T03:14:54.030ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::a]:33234
772026-04-10T03:14:54.030ZINFOdns-server (http): request completed latency_us = 185 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:33234 req_id = dc9ccac0-cf32-49b6-bbf4-0235e91c7bbf response_code = 200 uri = /config
782026-04-10T03:14:54.038ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22425, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:31066 req_id = 22d01b1a-f90f-41ee-b471-4c0dc20ad418
792026-04-10T03:14:54.137ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::c]:50404
802026-04-10T03:14:54.137ZINFOdns-server (http): request completed latency_us = 194 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:50404 req_id = cac43347-eec8-4963-ada6-79508febd702 response_code = 200 uri = /config
812026-04-10T03:14:54.230ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 64059, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:10236 req_id = 53625e0f-31b8-469a-aa43-a2af36d35370
822026-04-10T03:14:54.322ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:101::b]:34455
832026-04-10T03:14:54.323ZINFOdns-server (http): request completed latency_us = 229 local_addr = [fd00:1122:3344:1::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:34455 req_id = 940dafaf-3f2a-4568-b133-546eb33eae1d response_code = 200 uri = /config
842026-04-10T03:14:54.580ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25308, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:64174 req_id = 27531fb0-bf21-4f4b-8e22-7df3e7f65b36
852026-04-10T03:15:00.156ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59379, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), ), original: Query { name: Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 52, 51, 54, 50, 54, 102, 54, 45, 98, 102, 98, 99, 45, 52, 55, 52, 50, 45, 57, 99, 52, 56, 45, 49, 55, 102, 49, 52, 101, 54, 49, 51, 98, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68." peer_addr = [fd00:1122:3344:101::e]:44481 req_id = c54fadfd-bb43-4f7f-b063-a493d6436d64
862026-04-10T03:15:00.156ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59379, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), ), original: Query { name: Name("oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 52, 51, 54, 50, 54, 102, 54, 45, 98, 102, 98, 99, 45, 52, 55, 52, 50, 45, 57, 99, 52, 56, 45, 49, 55, 102, 49, 52, 101, 54, 49, 51, 98, 54, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_943626f6-bfbc-4742-9c48-17f14e613b68." peer_addr = [fd00:1122:3344:101::e]:43249 req_id = 6b093aaa-27bc-44e7-a826-147c190fa00a
872026-04-10T03:15:00.800ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4903, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_39112fc7-8025-4b5f-b87d-6c88d324f549."), ), original: Query { name: Name("oxz_ntp_39112fc7-8025-4b5f-b87d-6c88d324f549."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 51, 57, 49, 49, 50, 102, 99, 55, 45, 56, 48, 50, 53, 45, 52, 98, 53, 102, 45, 98, 56, 55, 100, 45, 54, 99, 56, 56, 100, 51, 50, 52, 102, 53, 52, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_39112fc7-8025-4b5f-b87d-6c88d324f549." peer_addr = [fd00:1122:3344:101::1b]:62840 req_id = 9bef2fb2-7ce7-47ec-bd3f-cbe6651e38e5
882026-04-10T03:15:00.929ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39687, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca."), ), original: Query { name: Name("oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 51, 51, 51, 50, 52, 55, 53, 45, 49, 97, 55, 53, 45, 52, 98, 53, 55, 45, 57, 57, 52, 50, 45, 48, 100, 50, 56, 50, 48, 50, 97, 53, 48, 99, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca." peer_addr = [fd00:1122:3344:101::3]:54057 req_id = 76a21e6e-eace-4db6-b382-ad78dde3b12b
892026-04-10T03:15:00.930ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39687, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca."), ), original: Query { name: Name("oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 100, 51, 51, 51, 50, 52, 55, 53, 45, 49, 97, 55, 53, 45, 52, 98, 53, 55, 45, 57, 57, 52, 50, 45, 48, 100, 50, 56, 50, 48, 50, 97, 53, 48, 99, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_d3332475-1a75-4b57-9942-0d28202a50ca." peer_addr = [fd00:1122:3344:101::3]:61985 req_id = eeba045d-6bb7-4f66-981a-957641b89e9d
902026-04-10T03:15:00.931ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20678, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9."), ), original: Query { name: Name("oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 100, 50, 51, 101, 53, 99, 54, 45, 102, 52, 99, 48, 45, 52, 50, 52, 54, 45, 56, 51, 97, 97, 45, 97, 53, 49, 52, 57, 48, 51, 54, 54, 56, 101, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9." peer_addr = [fd00:1122:3344:101::5]:46450 req_id = 93b6d0fa-8ef0-477d-b80c-b30d2a16230c
912026-04-10T03:15:00.932ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20678, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9."), ), original: Query { name: Name("oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 100, 50, 51, 101, 53, 99, 54, 45, 102, 52, 99, 48, 45, 52, 50, 52, 54, 45, 56, 51, 97, 97, 45, 97, 53, 49, 52, 57, 48, 51, 54, 54, 56, 101, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1d23e5c6-f4c0-4246-83aa-a514903668e9." peer_addr = [fd00:1122:3344:101::5]:42971 req_id = a51e6d23-107d-4d83-84d3-abf4f7cbc889
922026-04-10T03:15:00.958ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4357, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2."), ), original: Query { name: Name("oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 53, 48, 97, 99, 57, 57, 54, 45, 97, 100, 48, 57, 45, 52, 57, 55, 57, 45, 57, 97, 51, 101, 45, 57, 100, 51, 101, 57, 57, 100, 49, 54, 48, 101, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2." peer_addr = [fd00:1122:3344:101::7]:63587 req_id = b9fc45c5-432e-4d75-9d71-0dd8798355e6
932026-04-10T03:15:00.959ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4357, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2."), ), original: Query { name: Name("oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 53, 48, 97, 99, 57, 57, 54, 45, 97, 100, 48, 57, 45, 52, 57, 55, 57, 45, 57, 97, 51, 101, 45, 57, 100, 51, 101, 57, 57, 100, 49, 54, 48, 101, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_050ac996-ad09-4979-9a3e-9d3e99d160e2." peer_addr = [fd00:1122:3344:101::7]:49444 req_id = b2da18fb-8af5-4a4b-8ec9-9e306bf58775
942026-04-10T03:15:00.969ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47263, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee."), ), original: Query { name: Name("oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 100, 49, 50, 99, 51, 54, 101, 45, 98, 98, 57, 54, 45, 52, 99, 102, 49, 45, 56, 50, 97, 98, 45, 57, 52, 50, 101, 49, 99, 55, 102, 52, 54, 101, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee." peer_addr = [fd00:1122:3344:101::4]:64304 req_id = facf79a3-b546-4f05-b0ac-917bd0c555e2
952026-04-10T03:15:00.969ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47263, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee."), ), original: Query { name: Name("oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 100, 49, 50, 99, 51, 54, 101, 45, 98, 98, 57, 54, 45, 52, 99, 102, 49, 45, 56, 50, 97, 98, 45, 57, 52, 50, 101, 49, 99, 55, 102, 52, 54, 101, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1d12c36e-bb96-4cf1-82ab-942e1c7f46ee." peer_addr = [fd00:1122:3344:101::4]:34002 req_id = 1c15151d-3412-4e5f-a679-bd4ca1e1b442
962026-04-10T03:15:00.973ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54518, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd."), ), original: Query { name: Name("oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 55, 101, 98, 55, 55, 102, 99, 45, 57, 55, 101, 102, 45, 52, 56, 52, 48, 45, 57, 53, 99, 51, 45, 102, 101, 55, 54, 53, 51, 53, 56, 51, 57, 100, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd." peer_addr = [fd00:1122:3344:101::6]:33458 req_id = 576c9c19-d521-45b2-9de1-29142e70c585
972026-04-10T03:15:00.973ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54518, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd."), ), original: Query { name: Name("oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 55, 101, 98, 55, 55, 102, 99, 45, 57, 55, 101, 102, 45, 52, 56, 52, 48, 45, 57, 53, 99, 51, 45, 102, 101, 55, 54, 53, 51, 53, 56, 51, 57, 100, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_57eb77fc-97ef-4840-95c3-fe76535839dd." peer_addr = [fd00:1122:3344:101::6]:60466 req_id = 57a79293-b6dc-41ef-82b3-d447331406c0
982026-04-10T03:15:01.261ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39376, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:50284 req_id = c79812d5-3ca2-4f47-9dfe-95bf52feb00c
992026-04-10T03:15:01.262ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39376, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:53652 req_id = 204f3e56-c870-4656-a802-a36116e771c4