Max level shown:
1 [ Jul 15 04:12:48 Enabled. ]
2 [ Jul 15 04:12:48 Rereading configuration. ]
3 [ Jul 15 04:12:49 Rereading configuration. ]
4 [ Jul 15 04:12:51 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Jul 15 04:12:51 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-07-15T04:12:51.051ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-07-15T04:12:51.065ZINFOdns-server (store): opening sled database path = /data/dns
102026-07-15T04:12:51.073ZINFOdns-server (store): pruning trees for generations newer than 0
112026-07-15T04:12:51.073ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-07-15T04:12:51.073ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-07-15T04:12:51.073ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-07-15T04:12:51.266ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:64790
152026-07-15T04:12:51.267ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 380b0ec5-35dd-4a8f-b81a-dc9abda5a568
162026-07-15T04:12:51.267ZINFOdns-server (store): pruning trees for generations newer than 0
172026-07-15T04:12:51.305ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-07-15T04:12:51.305ZINFOdns-server (store): updated generation new_generation = 1 req_id = 380b0ec5-35dd-4a8f-b81a-dc9abda5a568
192026-07-15T04:12:51.305ZINFOdns-server (http): request completed latency_us = 38281 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:64790 req_id = 380b0ec5-35dd-4a8f-b81a-dc9abda5a568 response_code = 204 uri = /config
202026-07-15T04:13:05.295ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12638, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:64522 req_id = 104b1245-64ef-4074-873e-03df9647ae5f
212026-07-15T04:13:05.300ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27058, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:51894 req_id = 3dc0d87f-8823-48d3-8d13-921d07288b2f
222026-07-15T04:13:05.304ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43221, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59979 req_id = c7c0d64a-e504-42e6-a948-c62460386248
232026-07-15T04:14:47.674ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30251, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:59929 req_id = 34752d09-5b95-4daf-b81e-0835297092fc
242026-07-15T04:14:51.263ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34153, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70."), ), original: Query { name: Name("oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 53, 52, 51, 99, 52, 52, 52, 101, 45, 48, 97, 99, 49, 45, 52, 102, 57, 97, 45, 56, 102, 99, 56, 45, 51, 50, 53, 50, 50, 56, 102, 54, 48, 100, 55, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70." peer_addr = [fd00:1122:3344:101::e]:33982 req_id = 81d50d5a-cd99-41d1-9667-c47efb6f7ea4
252026-07-15T04:14:51.264ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34153, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70."), ), original: Query { name: Name("oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 53, 52, 51, 99, 52, 52, 52, 101, 45, 48, 97, 99, 49, 45, 52, 102, 57, 97, 45, 56, 102, 99, 56, 45, 51, 50, 53, 50, 50, 56, 102, 54, 48, 100, 55, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70." peer_addr = [fd00:1122:3344:101::e]:35302 req_id = ac634249-4349-4e52-a02e-8622d4ecc8be
262026-07-15T04:14:57.656ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10035, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57209 req_id = 1b030f8a-82da-4832-bbc2-25f04e0e9d97
272026-07-15T04:14:58.587ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62804, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:35609 req_id = 26beb6b6-c501-4af8-ba1b-2fe3d73c4067
282026-07-15T04:14:58.638ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 43770, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:21460 req_id = 340ba48a-1e40-432a-9b1f-87d807bcbea8
292026-07-15T04:14:58.854ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25518, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:13226 req_id = e35c9e9f-d9b0-4ff2-afbc-1788328627c3
302026-07-15T04:15:00.145ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41239, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70."), ), original: Query { name: Name("oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 53, 52, 51, 99, 52, 52, 52, 101, 45, 48, 97, 99, 49, 45, 52, 102, 57, 97, 45, 56, 102, 99, 56, 45, 51, 50, 53, 50, 50, 56, 102, 54, 48, 100, 55, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70." peer_addr = [fd00:1122:3344:101::e]:58953 req_id = 450d80e4-2008-40ce-971a-1bc3c6b28e4d
312026-07-15T04:15:00.146ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41239, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70."), ), original: Query { name: Name("oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 53, 52, 51, 99, 52, 52, 52, 101, 45, 48, 97, 99, 49, 45, 52, 102, 57, 97, 45, 56, 102, 99, 56, 45, 51, 50, 53, 50, 50, 56, 102, 54, 48, 100, 55, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_543c444e-0ac1-4f9a-8fc8-325228f60d70." peer_addr = [fd00:1122:3344:101::e]:43225 req_id = 4316418f-09e4-45f4-8f0e-7ccd8e9eff24
322026-07-15T04:15:00.147ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29126, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_1c8445b4-f49a-4c3e-ac9f-570f41e60360."), ), original: Query { name: Name("oxz_ntp_1c8445b4-f49a-4c3e-ac9f-570f41e60360."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 49, 99, 56, 52, 52, 53, 98, 52, 45, 102, 52, 57, 97, 45, 52, 99, 51, 101, 45, 97, 99, 57, 102, 45, 53, 55, 48, 102, 52, 49, 101, 54, 48, 51, 54, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_1c8445b4-f49a-4c3e-ac9f-570f41e60360." peer_addr = [fd00:1122:3344:101::1b]:60524 req_id = 2ec3c8c8-afa5-4482-b425-089498a2a483
332026-07-15T04:15:00.571ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9606, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ab3904d1-d290-4bfd-ba92-e69f9acbbd35."), ), original: Query { name: Name("oxz_cockroachdb_ab3904d1-d290-4bfd-ba92-e69f9acbbd35."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 98, 51, 57, 48, 52, 100, 49, 45, 100, 50, 57, 48, 45, 52, 98, 102, 100, 45, 98, 97, 57, 50, 45, 101, 54, 57, 102, 57, 97, 99, 98, 98, 100, 51, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ab3904d1-d290-4bfd-ba92-e69f9acbbd35." peer_addr = [fd00:1122:3344:101::7]:57506 req_id = 87fef59e-f610-4430-9d01-d78959a2e087
342026-07-15T04:15:00.572ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9606, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ab3904d1-d290-4bfd-ba92-e69f9acbbd35."), ), original: Query { name: Name("oxz_cockroachdb_ab3904d1-d290-4bfd-ba92-e69f9acbbd35."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 98, 51, 57, 48, 52, 100, 49, 45, 100, 50, 57, 48, 45, 52, 98, 102, 100, 45, 98, 97, 57, 50, 45, 101, 54, 57, 102, 57, 97, 99, 98, 98, 100, 51, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ab3904d1-d290-4bfd-ba92-e69f9acbbd35." peer_addr = [fd00:1122:3344:101::7]:39739 req_id = fdf07e34-eef7-4b62-8348-1c8d42a6ee60
352026-07-15T04:15:00.618ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61664, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a453cd33-c843-40b1-8d38-2d14eed560fd."), ), original: Query { name: Name("oxz_cockroachdb_a453cd33-c843-40b1-8d38-2d14eed560fd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 52, 53, 51, 99, 100, 51, 51, 45, 99, 56, 52, 51, 45, 52, 48, 98, 49, 45, 56, 100, 51, 56, 45, 50, 100, 49, 52, 101, 101, 100, 53, 54, 48, 102, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a453cd33-c843-40b1-8d38-2d14eed560fd." peer_addr = [fd00:1122:3344:101::4]:41140 req_id = f76e44a2-0aa5-4b53-afa0-bafa3e23fa1b
362026-07-15T04:15:00.618ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61664, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a453cd33-c843-40b1-8d38-2d14eed560fd."), ), original: Query { name: Name("oxz_cockroachdb_a453cd33-c843-40b1-8d38-2d14eed560fd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 52, 53, 51, 99, 100, 51, 51, 45, 99, 56, 52, 51, 45, 52, 48, 98, 49, 45, 56, 100, 51, 56, 45, 50, 100, 49, 52, 101, 101, 100, 53, 54, 48, 102, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a453cd33-c843-40b1-8d38-2d14eed560fd." peer_addr = [fd00:1122:3344:101::4]:37776 req_id = f2d5afb5-5688-4915-b1f5-267cec301bb5
372026-07-15T04:15:00.669ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27353, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8ef14a31-7609-4df5-a935-c45bb64a09b8."), ), original: Query { name: Name("oxz_cockroachdb_8ef14a31-7609-4df5-a935-c45bb64a09b8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 101, 102, 49, 52, 97, 51, 49, 45, 55, 54, 48, 57, 45, 52, 100, 102, 53, 45, 97, 57, 51, 53, 45, 99, 52, 53, 98, 98, 54, 52, 97, 48, 57, 98, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8ef14a31-7609-4df5-a935-c45bb64a09b8." peer_addr = [fd00:1122:3344:101::3]:50152 req_id = 588158c5-1ea7-4930-8ee2-becf88e36e3a
382026-07-15T04:15:00.671ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27353, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_8ef14a31-7609-4df5-a935-c45bb64a09b8."), ), original: Query { name: Name("oxz_cockroachdb_8ef14a31-7609-4df5-a935-c45bb64a09b8."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 101, 102, 49, 52, 97, 51, 49, 45, 55, 54, 48, 57, 45, 52, 100, 102, 53, 45, 97, 57, 51, 53, 45, 99, 52, 53, 98, 98, 54, 52, 97, 48, 57, 98, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_8ef14a31-7609-4df5-a935-c45bb64a09b8." peer_addr = [fd00:1122:3344:101::3]:61028 req_id = a2ca3295-cb4a-447a-8db9-55f5d653bbea
392026-07-15T04:15:00.781ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4699, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:39587 req_id = 4f3b5c34-189b-4ffe-a3a7-b737a959eb19
402026-07-15T04:15:00.782ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4699, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:41400 req_id = 4e03e450-214e-47e8-9d8a-0a9fe0658650
412026-07-15T04:15:00.787ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44988, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_707038b7-a7a9-41ab-b4d0-53457ef32614."), ), original: Query { name: Name("oxz_cockroachdb_707038b7-a7a9-41ab-b4d0-53457ef32614."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 48, 55, 48, 51, 56, 98, 55, 45, 97, 55, 97, 57, 45, 52, 49, 97, 98, 45, 98, 52, 100, 48, 45, 53, 51, 52, 53, 55, 101, 102, 51, 50, 54, 49, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_707038b7-a7a9-41ab-b4d0-53457ef32614." peer_addr = [fd00:1122:3344:101::6]:34164 req_id = ce820c4b-bb5c-48ff-923b-4d790918feed
422026-07-15T04:15:00.788ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44988, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_707038b7-a7a9-41ab-b4d0-53457ef32614."), ), original: Query { name: Name("oxz_cockroachdb_707038b7-a7a9-41ab-b4d0-53457ef32614."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 48, 55, 48, 51, 56, 98, 55, 45, 97, 55, 97, 57, 45, 52, 49, 97, 98, 45, 98, 52, 100, 48, 45, 53, 51, 52, 53, 55, 101, 102, 51, 50, 54, 49, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_707038b7-a7a9-41ab-b4d0-53457ef32614." peer_addr = [fd00:1122:3344:101::6]:61529 req_id = d2f20841-68a6-4572-98c6-932cc4a2475d
432026-07-15T04:15:00.833ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12580, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1f97affc-52c5-48fb-9c55-8572752edd46."), ), original: Query { name: Name("oxz_cockroachdb_1f97affc-52c5-48fb-9c55-8572752edd46."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 102, 57, 55, 97, 102, 102, 99, 45, 53, 50, 99, 53, 45, 52, 56, 102, 98, 45, 57, 99, 53, 53, 45, 56, 53, 55, 50, 55, 53, 50, 101, 100, 100, 52, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1f97affc-52c5-48fb-9c55-8572752edd46." peer_addr = [fd00:1122:3344:101::5]:36850 req_id = c31bb470-79a7-46cd-8544-88b9ab8aa321
442026-07-15T04:15:00.833ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12580, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_1f97affc-52c5-48fb-9c55-8572752edd46."), ), original: Query { name: Name("oxz_cockroachdb_1f97affc-52c5-48fb-9c55-8572752edd46."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 102, 57, 55, 97, 102, 102, 99, 45, 53, 50, 99, 53, 45, 52, 56, 102, 98, 45, 57, 99, 53, 53, 45, 56, 53, 55, 50, 55, 53, 50, 101, 100, 100, 52, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_1f97affc-52c5-48fb-9c55-8572752edd46." peer_addr = [fd00:1122:3344:101::5]:59062 req_id = 4806a828-a77c-4bda-a02e-7d3f11b668b1