Max level shown:
1 [ Jul 2 18:42:58 Enabled. ]
2 [ Jul 2 18:42:58 Rereading configuration. ]
3 [ Jul 2 18:42:59 Rereading configuration. ]
4 [ Jul 2 18:43:00 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Jul 2 18:43:00 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-07-02T18:43:00.502ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-07-02T18:43:00.502ZINFOdns-server (store): opening sled database path = /data/dns
102026-07-02T18:43:00.523ZINFOdns-server (store): pruning trees for generations newer than 0
112026-07-02T18:43:00.523ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-07-02T18:43:00.523ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-07-02T18:43:00.523ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-07-02T18:43:00.661ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:49689
152026-07-02T18:43:00.662ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 22cc9557-55ae-48e0-baf6-b89c2042bdd2
162026-07-02T18:43:00.662ZINFOdns-server (store): pruning trees for generations newer than 0
172026-07-02T18:43:00.675ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-07-02T18:43:00.675ZINFOdns-server (store): updated generation new_generation = 1 req_id = 22cc9557-55ae-48e0-baf6-b89c2042bdd2
192026-07-02T18:43:00.675ZINFOdns-server (http): request completed latency_us = 13648 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:49689 req_id = 22cc9557-55ae-48e0-baf6-b89c2042bdd2 response_code = 204 uri = /config
202026-07-02T18:43:11.848ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12751, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:41239 req_id = 7774ec21-70fc-46c4-a44d-4670e9827963
212026-07-02T18:43:11.853ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30968, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:46451 req_id = 351401f0-d5a4-44c7-9e6b-0eb1997258be
222026-07-02T18:43:11.858ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2924, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:63212 req_id = 21991e5e-7c15-469e-948a-d6ab4796ac71
232026-07-02T18:44:36.172ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16205, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:50461 req_id = 64e9a0f8-e679-4bc2-b83b-011c6a614e95
242026-07-02T18:44:36.177ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29974, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:34453 req_id = 14727189-ea02-4729-bd75-de1f37d35d77
252026-07-02T18:44:36.177ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40791, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:44585 req_id = b99ba9b8-508c-452c-8e63-fe28011eced5
262026-07-02T18:44:46.804ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 11119, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:65385 req_id = 54736e5d-e046-4172-8179-41e0fee47a90
272026-07-02T18:44:50.976ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19982, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84."), ), original: Query { name: Name("oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 102, 56, 52, 55, 55, 49, 102, 45, 56, 55, 57, 97, 45, 52, 102, 54, 100, 45, 98, 100, 100, 97, 45, 52, 50, 53, 57, 55, 51, 56, 54, 55, 101, 56, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84." peer_addr = [fd00:1122:3344:101::e]:51985 req_id = 75503f02-dc25-4b5a-b164-0339e17f50b0
282026-07-02T18:44:50.977ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19982, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84."), ), original: Query { name: Name("oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 102, 56, 52, 55, 55, 49, 102, 45, 56, 55, 57, 97, 45, 52, 102, 54, 100, 45, 98, 100, 100, 97, 45, 52, 50, 53, 57, 55, 51, 56, 54, 55, 101, 56, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84." peer_addr = [fd00:1122:3344:101::e]:52095 req_id = acb6dc18-3a69-4cf6-8653-0c156303d48d
292026-07-02T18:44:56.805ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22320, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:60272 req_id = c22b3238-9942-4db1-a424-2d793fbba4e7
302026-07-02T18:44:57.327ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10910, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:20008 req_id = bff06a92-9d02-49cb-bfd3-48df42e6a954
312026-07-02T18:44:57.603ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38805, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:17862 req_id = a8d03bcc-1507-4bf4-a2f1-e38dcbab4abd
322026-07-02T18:44:57.662ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53180, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:34568 req_id = 0d5590ef-9222-4093-baf4-662083e55ab9
332026-07-02T18:45:00.475ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7350, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84."), ), original: Query { name: Name("oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 102, 56, 52, 55, 55, 49, 102, 45, 56, 55, 57, 97, 45, 52, 102, 54, 100, 45, 98, 100, 100, 97, 45, 52, 50, 53, 57, 55, 51, 56, 54, 55, 101, 56, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84." peer_addr = [fd00:1122:3344:101::e]:56384 req_id = 534a072b-b886-4709-94c1-11d92b7188d8
342026-07-02T18:45:00.475ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7350, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84."), ), original: Query { name: Name("oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 57, 102, 56, 52, 55, 55, 49, 102, 45, 56, 55, 57, 97, 45, 52, 102, 54, 100, 45, 98, 100, 100, 97, 45, 52, 50, 53, 57, 55, 51, 56, 54, 55, 101, 56, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_9f84771f-879a-4f6d-bdda-425973867e84." peer_addr = [fd00:1122:3344:101::e]:60205 req_id = d517459e-c33c-4c75-9c89-d142ea1098d0
352026-07-02T18:45:00.906ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26084, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_b2fa7812-1c6d-4951-85a1-e03ed9e7e652."), ), original: Query { name: Name("oxz_ntp_b2fa7812-1c6d-4951-85a1-e03ed9e7e652."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 98, 50, 102, 97, 55, 56, 49, 50, 45, 49, 99, 54, 100, 45, 52, 57, 53, 49, 45, 56, 53, 97, 49, 45, 101, 48, 51, 101, 100, 57, 101, 55, 101, 54, 53, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_b2fa7812-1c6d-4951-85a1-e03ed9e7e652." peer_addr = [fd00:1122:3344:101::1b]:49171 req_id = ca2931fb-a36c-4d9b-9057-46615afb22a5
362026-07-02T18:45:00.924ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63941, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9c547794-382b-4f89-9559-eb28c6a752d2."), ), original: Query { name: Name("oxz_cockroachdb_9c547794-382b-4f89-9559-eb28c6a752d2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 99, 53, 52, 55, 55, 57, 52, 45, 51, 56, 50, 98, 45, 52, 102, 56, 57, 45, 57, 53, 53, 57, 45, 101, 98, 50, 56, 99, 54, 97, 55, 53, 50, 100, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9c547794-382b-4f89-9559-eb28c6a752d2." peer_addr = [fd00:1122:3344:101::7]:58300 req_id = 77adaf49-d5d1-469f-bcae-9cc1aa77a4a0
372026-07-02T18:45:00.925ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63941, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_9c547794-382b-4f89-9559-eb28c6a752d2."), ), original: Query { name: Name("oxz_cockroachdb_9c547794-382b-4f89-9559-eb28c6a752d2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 99, 53, 52, 55, 55, 57, 52, 45, 51, 56, 50, 98, 45, 52, 102, 56, 57, 45, 57, 53, 53, 57, 45, 101, 98, 50, 56, 99, 54, 97, 55, 53, 50, 100, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_9c547794-382b-4f89-9559-eb28c6a752d2." peer_addr = [fd00:1122:3344:101::7]:42634 req_id = 6a333502-0359-401c-b942-03ddc5a148cc
382026-07-02T18:45:00.939ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9296, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c1eecf1b-9792-4d7a-a0ab-fe2a91ea7654."), ), original: Query { name: Name("oxz_cockroachdb_c1eecf1b-9792-4d7a-a0ab-fe2a91ea7654."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 49, 101, 101, 99, 102, 49, 98, 45, 57, 55, 57, 50, 45, 52, 100, 55, 97, 45, 97, 48, 97, 98, 45, 102, 101, 50, 97, 57, 49, 101, 97, 55, 54, 53, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c1eecf1b-9792-4d7a-a0ab-fe2a91ea7654." peer_addr = [fd00:1122:3344:101::6]:63349 req_id = 9e283731-3c4e-492d-b1ca-baed9443710b
392026-07-02T18:45:00.940ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9296, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c1eecf1b-9792-4d7a-a0ab-fe2a91ea7654."), ), original: Query { name: Name("oxz_cockroachdb_c1eecf1b-9792-4d7a-a0ab-fe2a91ea7654."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 49, 101, 101, 99, 102, 49, 98, 45, 57, 55, 57, 50, 45, 52, 100, 55, 97, 45, 97, 48, 97, 98, 45, 102, 101, 50, 97, 57, 49, 101, 97, 55, 54, 53, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c1eecf1b-9792-4d7a-a0ab-fe2a91ea7654." peer_addr = [fd00:1122:3344:101::6]:53853 req_id = 6ebd1afc-fdb0-41e4-bb7d-fedb7c74bbdf
402026-07-02T18:45:00.956ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63449, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b5361e1c-357a-4e18-ad52-93a7de7e02a2."), ), original: Query { name: Name("oxz_cockroachdb_b5361e1c-357a-4e18-ad52-93a7de7e02a2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 53, 51, 54, 49, 101, 49, 99, 45, 51, 53, 55, 97, 45, 52, 101, 49, 56, 45, 97, 100, 53, 50, 45, 57, 51, 97, 55, 100, 101, 55, 101, 48, 50, 97, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b5361e1c-357a-4e18-ad52-93a7de7e02a2." peer_addr = [fd00:1122:3344:101::4]:40274 req_id = eb9292ee-9b39-491b-81d0-e2aa4675c27a
412026-07-02T18:45:00.957ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63449, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b5361e1c-357a-4e18-ad52-93a7de7e02a2."), ), original: Query { name: Name("oxz_cockroachdb_b5361e1c-357a-4e18-ad52-93a7de7e02a2."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 53, 51, 54, 49, 101, 49, 99, 45, 51, 53, 55, 97, 45, 52, 101, 49, 56, 45, 97, 100, 53, 50, 45, 57, 51, 97, 55, 100, 101, 55, 101, 48, 50, 97, 50, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b5361e1c-357a-4e18-ad52-93a7de7e02a2." peer_addr = [fd00:1122:3344:101::4]:53370 req_id = 7d89a1d5-bbb3-4453-a79e-ff8156aa828c
422026-07-02T18:45:01.008ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14502, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_cc8519b6-4eca-4fd3-97ad-b811464378b0."), ), original: Query { name: Name("oxz_cockroachdb_cc8519b6-4eca-4fd3-97ad-b811464378b0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 99, 56, 53, 49, 57, 98, 54, 45, 52, 101, 99, 97, 45, 52, 102, 100, 51, 45, 57, 55, 97, 100, 45, 98, 56, 49, 49, 52, 54, 52, 51, 55, 56, 98, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_cc8519b6-4eca-4fd3-97ad-b811464378b0." peer_addr = [fd00:1122:3344:101::3]:45944 req_id = 81069912-601e-472e-8901-e4d986059fd0
432026-07-02T18:45:01.009ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14502, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_cc8519b6-4eca-4fd3-97ad-b811464378b0."), ), original: Query { name: Name("oxz_cockroachdb_cc8519b6-4eca-4fd3-97ad-b811464378b0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 99, 56, 53, 49, 57, 98, 54, 45, 52, 101, 99, 97, 45, 52, 102, 100, 51, 45, 57, 55, 97, 100, 45, 98, 56, 49, 49, 52, 54, 52, 51, 55, 56, 98, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_cc8519b6-4eca-4fd3-97ad-b811464378b0." peer_addr = [fd00:1122:3344:101::3]:62979 req_id = 95fb865a-d74f-4493-ae47-e9e9c4b747c8
442026-07-02T18:45:01.019ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12952, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7d30fd79-510e-47e2-8f54-253d2473a58c."), ), original: Query { name: Name("oxz_cockroachdb_7d30fd79-510e-47e2-8f54-253d2473a58c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 100, 51, 48, 102, 100, 55, 57, 45, 53, 49, 48, 101, 45, 52, 55, 101, 50, 45, 56, 102, 53, 52, 45, 50, 53, 51, 100, 50, 52, 55, 51, 97, 53, 56, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7d30fd79-510e-47e2-8f54-253d2473a58c." peer_addr = [fd00:1122:3344:101::5]:62303 req_id = d2c1bc04-9f04-4cd4-8375-a7268f993d44
452026-07-02T18:45:01.020ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12952, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7d30fd79-510e-47e2-8f54-253d2473a58c."), ), original: Query { name: Name("oxz_cockroachdb_7d30fd79-510e-47e2-8f54-253d2473a58c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 100, 51, 48, 102, 100, 55, 57, 45, 53, 49, 48, 101, 45, 52, 55, 101, 50, 45, 56, 102, 53, 52, 45, 50, 53, 51, 100, 50, 52, 55, 51, 97, 53, 56, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7d30fd79-510e-47e2-8f54-253d2473a58c." peer_addr = [fd00:1122:3344:101::5]:46892 req_id = e7cebcb2-2916-4939-a1eb-4547754a5f39
462026-07-02T18:45:01.212ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61430, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:52202 req_id = 453ffb20-1a03-4081-92bb-a4afedd220e6
472026-07-02T18:45:01.212ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61430, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:58402 req_id = f78739bd-2f45-4249-9984-b6d121fae68b