Max level shown:
1 [ Mar 30 18:54:53 Enabled. ]
2 [ Mar 30 18:54:53 Rereading configuration. ]
3 [ Mar 30 18:54:54 Rereading configuration. ]
4 [ Mar 30 18:54:55 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Mar 30 18:54:55 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-03-30T18:54:55.397ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [] }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-03-30T18:54:55.398ZINFOdns-server (store): opening sled database path = /data/dns
102026-03-30T18:54:55.418ZINFOdns-server (store): pruning trees for generations newer than 0
112026-03-30T18:54:55.418ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-03-30T18:54:55.418ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-03-30T18:54:55.419ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-03-30T18:54:55.598ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:43649
152026-03-30T18:54:55.598ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = abe52320-7cd5-4c0a-9d9d-98f532efd3a5
162026-03-30T18:54:55.598ZINFOdns-server (store): pruning trees for generations newer than 0
172026-03-30T18:54:55.615ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-03-30T18:54:55.615ZINFOdns-server (store): updated generation new_generation = 1 req_id = abe52320-7cd5-4c0a-9d9d-98f532efd3a5
192026-03-30T18:54:55.615ZINFOdns-server (http): request completed latency_us = 17090 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:43649 req_id = abe52320-7cd5-4c0a-9d9d-98f532efd3a5 response_code = 204 uri = /config
202026-03-30T18:55:09.752ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24641, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:39553 req_id = 2c48762f-235e-4b43-8a75-b3e991f951ca
212026-03-30T18:55:09.756ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56735, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:57073 req_id = 2648eca6-20a0-4513-99d5-2a1d3d1e173c
222026-03-30T18:55:09.760ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20252, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:47206 req_id = 81028c43-15bb-444e-b8bd-ff8d1d386fbe
232026-03-30T18:58:27.719ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36911, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:62905 req_id = 2e76a598-1f8d-4206-a666-527cd593e51b
242026-03-30T18:58:37.689ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 889, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:54459 req_id = 2649372f-6a82-473e-993f-7f3d88dfa750
252026-03-30T18:58:43.784ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5819, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29."), ), original: Query { name: Name("oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 49, 48, 52, 57, 102, 99, 55, 45, 100, 57, 98, 49, 45, 52, 57, 57, 54, 45, 98, 102, 51, 52, 45, 97, 53, 102, 100, 97, 48, 48, 50, 97, 102, 50, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29." peer_addr = [fd00:1122:3344:101::e]:58089 req_id = 28f94ff5-896e-45dd-a52c-a2b96804b077
262026-03-30T18:58:43.785ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5819, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29."), ), original: Query { name: Name("oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 49, 48, 52, 57, 102, 99, 55, 45, 100, 57, 98, 49, 45, 52, 57, 57, 54, 45, 98, 102, 51, 52, 45, 97, 53, 102, 100, 97, 48, 48, 50, 97, 102, 50, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29." peer_addr = [fd00:1122:3344:101::e]:60053 req_id = df274162-dc36-427b-a00d-c6af6da82eb4
272026-03-30T18:58:47.208ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8426, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:31774 req_id = d92f431d-6d62-4789-ac25-55e39bba79c6
282026-03-30T18:58:47.366ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 4731, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:23628 req_id = 60edd2c5-f209-460f-aa3c-5e0423dbb54d
292026-03-30T18:58:47.669ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61965, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:53753 req_id = f5b2535f-c419-4e71-91bd-62b4ae326c32
302026-03-30T18:58:47.690ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9641, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:62102 req_id = 4c793883-eaf0-4943-bb1c-27d9db801b5f
312026-03-30T18:58:49.902ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:53218
322026-03-30T18:58:50.023ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = ef563500-b1a7-47e8-8158-b3fab12eee7f
332026-03-30T18:58:50.023ZINFOdns-server (store): updated generation new_generation = 1 req_id = ef563500-b1a7-47e8-8158-b3fab12eee7f
342026-03-30T18:58:50.023ZINFOdns-server (http): request completed latency_us = 43786 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:53218 req_id = ef563500-b1a7-47e8-8158-b3fab12eee7f response_code = 204 uri = /config
352026-03-30T18:58:50.350ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:58124
362026-03-30T18:58:50.350ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:36309
372026-03-30T18:58:50.350ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:56246
382026-03-30T18:58:50.353ZINFOdns-server (http): request completed latency_us = 2745 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:36309 req_id = 0470103c-b7f8-48b0-910a-5c91c8dab117 response_code = 200 uri = /config
392026-03-30T18:58:50.353ZINFOdns-server (http): request completed latency_us = 2859 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:58124 req_id = a911e531-451a-47a8-9503-25adb20f83ac response_code = 200 uri = /config
402026-03-30T18:58:50.353ZINFOdns-server (http): request completed latency_us = 2725 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:56246 req_id = a6aeaee8-4a37-4b16-a9db-34f31893e6cc response_code = 200 uri = /config
412026-03-30T18:58:52.597ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8928, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:25245 req_id = e1ce1153-8830-40f6-805c-c22e226a19a8
422026-03-30T18:58:52.597ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32171, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:25708 req_id = cf95abc7-bcf4-43f4-9b62-0849c15a62e0
432026-03-30T18:58:52.714ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:40620
442026-03-30T18:58:52.714ZINFOdns-server (http): request completed latency_us = 215 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:40620 req_id = 4e266bb6-c4e1-4a81-b081-9465abebe5a0 response_code = 200 uri = /config
452026-03-30T18:58:52.772ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:42560
462026-03-30T18:58:52.773ZINFOdns-server (http): request completed latency_us = 288 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:42560 req_id = 4d64c4f8-fa1d-4ae9-a722-a2bca8a98d03 response_code = 200 uri = /config
472026-03-30T18:58:54.540ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 5982, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:18314 req_id = c60d1171-9e0f-4d23-835c-4e0e3f5e96f8
482026-03-30T18:58:54.750ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:57964
492026-03-30T18:58:54.750ZINFOdns-server (http): request completed latency_us = 190 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:57964 req_id = 6de8eff7-135d-4457-aba6-89b1e7cb61bd response_code = 200 uri = /config
502026-03-30T18:58:57.692ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29686, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55880 req_id = c18161e6-ed39-49a7-badb-2ee9f0cf5ff2
512026-03-30T18:58:58.115ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53378, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:12389 req_id = 6afb8f08-6ba1-4578-be5c-f566beaf565e
522026-03-30T18:58:58.177ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7341, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:5628 req_id = a15af440-64ba-4ff5-bad5-79fc2b40f875
532026-03-30T18:58:58.232ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:43080
542026-03-30T18:58:58.232ZINFOdns-server (http): request completed latency_us = 197 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:43080 req_id = ed2fb7f6-d9db-48b3-badb-5c66443ddbd8 response_code = 200 uri = /config
552026-03-30T18:58:58.294ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:60765
562026-03-30T18:58:58.294ZINFOdns-server (http): request completed latency_us = 184 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:60765 req_id = 616d6c0b-dc94-424d-88e1-a949da9de436 response_code = 200 uri = /config
572026-03-30T18:59:01.332ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47967, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:52225 req_id = eacedd9f-1ac2-4061-82c7-a8a7ffe93954
582026-03-30T18:59:01.337ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 63777, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:61948 req_id = bffd6739-c0cf-49bb-8395-50262306ad7e
592026-03-30T18:59:01.342ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 60962, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:39597 req_id = 09f5a9fc-8ebf-47c3-b1c3-aa9ea171b110
602026-03-30T18:59:07.693ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10183, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:65440 req_id = c7319ce0-c2b1-4576-a028-1dc7201c2c6b
612026-03-30T18:59:17.694ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 21631, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:50255 req_id = 845adde5-1b7e-4312-8866-b5035b654009
622026-03-30T18:59:27.695ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37332, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55536 req_id = b9814f2b-3604-4f09-97f3-9a25f3440492
632026-03-30T18:59:37.697ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45251, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:57794 req_id = 82e9451b-c78c-43dc-add7-ee9ab33fc860
642026-03-30T18:59:47.077ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:57746
652026-03-30T18:59:47.077ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e5d64035-60f9-4c65-b852-704de2d27024
662026-03-30T18:59:47.077ZINFOdns-server (store): updated generation new_generation = 1 req_id = e5d64035-60f9-4c65-b852-704de2d27024
672026-03-30T18:59:47.077ZINFOdns-server (http): request completed latency_us = 280 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::c]:57746 req_id = e5d64035-60f9-4c65-b852-704de2d27024 response_code = 204 uri = /config
682026-03-30T18:59:47.351ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:41168
692026-03-30T18:59:47.352ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = c3257e5b-27d8-49c8-b93c-29ec92452272
702026-03-30T18:59:47.352ZINFOdns-server (store): updated generation new_generation = 1 req_id = c3257e5b-27d8-49c8-b93c-29ec92452272
712026-03-30T18:59:47.352ZINFOdns-server (http): request completed latency_us = 385 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::a]:41168 req_id = c3257e5b-27d8-49c8-b93c-29ec92452272 response_code = 204 uri = /config
722026-03-30T18:59:47.467ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:36959
732026-03-30T18:59:47.468ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = a9456440-24de-4d4d-97cb-a6c23ff59810
742026-03-30T18:59:47.468ZINFOdns-server (store): updated generation new_generation = 1 req_id = a9456440-24de-4d4d-97cb-a6c23ff59810
752026-03-30T18:59:47.468ZINFOdns-server (http): request completed latency_us = 277 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:101::b]:36959 req_id = a9456440-24de-4d4d-97cb-a6c23ff59810 response_code = 204 uri = /config
762026-03-30T18:59:47.698ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49455, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:52244 req_id = 03cf022c-281e-495d-aa19-f53b025fdb97
772026-03-30T18:59:48.595ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36547, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::c]:36279 req_id = f6c38de9-f950-4ca3-9152-043937413709
782026-03-30T18:59:48.601ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47483, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::a]:51288 req_id = 2d870d9b-042b-4cbd-81fa-7b7d6150ed99
792026-03-30T18:59:48.696ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::c]:62869
802026-03-30T18:59:48.696ZINFOdns-server (http): request completed latency_us = 218 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::c]:62869 req_id = 085e3931-8dc7-40e4-a976-55b852d10045 response_code = 200 uri = /config
812026-03-30T18:59:48.730ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::a]:47215
822026-03-30T18:59:48.730ZINFOdns-server (http): request completed latency_us = 214 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::a]:47215 req_id = d79b8ee8-c11a-4de8-bfd3-eb81b700da43 response_code = 200 uri = /config
832026-03-30T18:59:49.447ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7759, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::b]:32298 req_id = 3cda441e-fd14-435c-bcb9-1476d4c6e790
842026-03-30T18:59:49.542ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:101::b]:50002
852026-03-30T18:59:49.542ZINFOdns-server (http): request completed latency_us = 210 local_addr = [fd00:1122:3344:3::1]:5353 method = GET remote_addr = [fd00:1122:3344:101::b]:50002 req_id = f2d3033a-498f-449f-a561-579c5240b77d response_code = 200 uri = /config
862026-03-30T18:59:57.699ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19443, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-cluster-native._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 26, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 99, 108, 117, 115, 116, 101, 114, 45, 110, 97, 116, 105, 118, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal peer_addr = [fd00:1122:3344:101::d]:55211 req_id = c972d77d-1337-4dd1-9555-e2900b0e2453
872026-03-30T19:00:00.049ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46682, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29."), ), original: Query { name: Name("oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 49, 48, 52, 57, 102, 99, 55, 45, 100, 57, 98, 49, 45, 52, 57, 57, 54, 45, 98, 102, 51, 52, 45, 97, 53, 102, 100, 97, 48, 48, 50, 97, 102, 50, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29." peer_addr = [fd00:1122:3344:101::e]:46502 req_id = 84da4e04-4e61-48f8-bfff-bd1c933459ce
882026-03-30T19:00:00.050ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46682, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29."), ), original: Query { name: Name("oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29."), query_type: A, query_class: IN, }, }, ], original: [ 51, 111, 120, 122, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 95, 55, 49, 48, 52, 57, 102, 99, 55, 45, 100, 57, 98, 49, 45, 52, 57, 57, 54, 45, 98, 102, 51, 52, 45, 97, 53, 102, 100, 97, 48, 48, 50, 97, 102, 50, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_clickhouse_71049fc7-d9b1-4996-bf34-a5fda002af29." peer_addr = [fd00:1122:3344:101::e]:49606 req_id = 11f4da02-ffca-4e7f-bc61-26ea04a2a2ae
892026-03-30T19:00:00.630ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44440, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:63207 req_id = 913888a4-1a3e-4aee-ab83-f0980341b048
902026-03-30T19:00:00.631ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44440, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:48464 req_id = 2ce709af-a743-4cfe-a6fa-d37f86edaeae
912026-03-30T19:00:00.779ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57268, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_4886d912-455e-46e9-b64c-055c5bb189bf."), ), original: Query { name: Name("oxz_cockroachdb_4886d912-455e-46e9-b64c-055c5bb189bf."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 56, 56, 54, 100, 57, 49, 50, 45, 52, 53, 53, 101, 45, 52, 54, 101, 57, 45, 98, 54, 52, 99, 45, 48, 53, 53, 99, 53, 98, 98, 49, 56, 57, 98, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_4886d912-455e-46e9-b64c-055c5bb189bf." peer_addr = [fd00:1122:3344:101::5]:43398 req_id = b67bea9d-3898-4ab0-bd62-8a79d9311601
922026-03-30T19:00:00.779ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 57268, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_4886d912-455e-46e9-b64c-055c5bb189bf."), ), original: Query { name: Name("oxz_cockroachdb_4886d912-455e-46e9-b64c-055c5bb189bf."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 56, 56, 54, 100, 57, 49, 50, 45, 52, 53, 53, 101, 45, 52, 54, 101, 57, 45, 98, 54, 52, 99, 45, 48, 53, 53, 99, 53, 98, 98, 49, 56, 57, 98, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_4886d912-455e-46e9-b64c-055c5bb189bf." peer_addr = [fd00:1122:3344:101::5]:54296 req_id = 38ff1d24-e0a5-4b9e-8475-29cf714ed57c
932026-03-30T19:00:00.842ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17319, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_75457ef0-e8f9-469b-9d0d-28dbab43479d."), ), original: Query { name: Name("oxz_cockroachdb_75457ef0-e8f9-469b-9d0d-28dbab43479d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 53, 52, 53, 55, 101, 102, 48, 45, 101, 56, 102, 57, 45, 52, 54, 57, 98, 45, 57, 100, 48, 100, 45, 50, 56, 100, 98, 97, 98, 52, 51, 52, 55, 57, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_75457ef0-e8f9-469b-9d0d-28dbab43479d." peer_addr = [fd00:1122:3344:101::4]:37114 req_id = e1c31255-d287-4de3-a763-301fcd216122
942026-03-30T19:00:00.843ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17319, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_75457ef0-e8f9-469b-9d0d-28dbab43479d."), ), original: Query { name: Name("oxz_cockroachdb_75457ef0-e8f9-469b-9d0d-28dbab43479d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 53, 52, 53, 55, 101, 102, 48, 45, 101, 56, 102, 57, 45, 52, 54, 57, 98, 45, 57, 100, 48, 100, 45, 50, 56, 100, 98, 97, 98, 52, 51, 52, 55, 57, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_75457ef0-e8f9-469b-9d0d-28dbab43479d." peer_addr = [fd00:1122:3344:101::4]:59648 req_id = 645e012c-9340-4a46-ba4d-9e0bd04d1c98
952026-03-30T19:00:00.843ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34920, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_6c673870-04e0-4f5e-86ac-13acbaa6e80d."), ), original: Query { name: Name("oxz_cockroachdb_6c673870-04e0-4f5e-86ac-13acbaa6e80d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 54, 99, 54, 55, 51, 56, 55, 48, 45, 48, 52, 101, 48, 45, 52, 102, 53, 101, 45, 56, 54, 97, 99, 45, 49, 51, 97, 99, 98, 97, 97, 54, 101, 56, 48, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_6c673870-04e0-4f5e-86ac-13acbaa6e80d." peer_addr = [fd00:1122:3344:101::6]:46158 req_id = bd033337-9fb5-4c5c-b658-4b8d29cbf12f
962026-03-30T19:00:00.844ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34920, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_6c673870-04e0-4f5e-86ac-13acbaa6e80d."), ), original: Query { name: Name("oxz_cockroachdb_6c673870-04e0-4f5e-86ac-13acbaa6e80d."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 54, 99, 54, 55, 51, 56, 55, 48, 45, 48, 52, 101, 48, 45, 52, 102, 53, 101, 45, 56, 54, 97, 99, 45, 49, 51, 97, 99, 98, 97, 97, 54, 101, 56, 48, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_6c673870-04e0-4f5e-86ac-13acbaa6e80d." peer_addr = [fd00:1122:3344:101::6]:57343 req_id = eb633872-8cc2-41a3-84c9-93c169700a1e
972026-03-30T19:00:00.853ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6543, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_499bc7f9-ea26-4551-b15a-4c666729397f."), ), original: Query { name: Name("oxz_ntp_499bc7f9-ea26-4551-b15a-4c666729397f."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 52, 57, 57, 98, 99, 55, 102, 57, 45, 101, 97, 50, 54, 45, 52, 53, 53, 49, 45, 98, 49, 53, 97, 45, 52, 99, 54, 54, 54, 55, 50, 57, 51, 57, 55, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_499bc7f9-ea26-4551-b15a-4c666729397f." peer_addr = [fd00:1122:3344:101::1b]:37416 req_id = 97ec5f45-457e-4c67-917f-a3bec65d7cc2
982026-03-30T19:00:00.925ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27672, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c2702ea3-ee6d-4d6b-a387-b7e9b52f5b23."), ), original: Query { name: Name("oxz_cockroachdb_c2702ea3-ee6d-4d6b-a387-b7e9b52f5b23."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 50, 55, 48, 50, 101, 97, 51, 45, 101, 101, 54, 100, 45, 52, 100, 54, 98, 45, 97, 51, 56, 55, 45, 98, 55, 101, 57, 98, 53, 50, 102, 53, 98, 50, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c2702ea3-ee6d-4d6b-a387-b7e9b52f5b23." peer_addr = [fd00:1122:3344:101::7]:61081 req_id = f0942292-e65e-492d-aa83-fbf133c9d350
992026-03-30T19:00:00.926ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27672, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_c2702ea3-ee6d-4d6b-a387-b7e9b52f5b23."), ), original: Query { name: Name("oxz_cockroachdb_c2702ea3-ee6d-4d6b-a387-b7e9b52f5b23."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 50, 55, 48, 50, 101, 97, 51, 45, 101, 101, 54, 100, 45, 52, 100, 54, 98, 45, 97, 51, 56, 55, 45, 98, 55, 101, 57, 98, 53, 50, 102, 53, 98, 50, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_c2702ea3-ee6d-4d6b-a387-b7e9b52f5b23." peer_addr = [fd00:1122:3344:101::7]:37177 req_id = cdeb8abf-c543-4708-bb1f-08daca521230
1002026-03-30T19:00:00.978ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33624, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_82190519-98d0-4c41-ad44-20be920cd8f5."), ), original: Query { name: Name("oxz_cockroachdb_82190519-98d0-4c41-ad44-20be920cd8f5."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 50, 49, 57, 48, 53, 49, 57, 45, 57, 56, 100, 48, 45, 52, 99, 52, 49, 45, 97, 100, 52, 52, 45, 50, 48, 98, 101, 57, 50, 48, 99, 100, 56, 102, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_82190519-98d0-4c41-ad44-20be920cd8f5." peer_addr = [fd00:1122:3344:101::3]:42301 req_id = 6da72dd0-6ba3-4f9a-9719-26a2fb743251
1012026-03-30T19:00:00.978ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33624, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_82190519-98d0-4c41-ad44-20be920cd8f5."), ), original: Query { name: Name("oxz_cockroachdb_82190519-98d0-4c41-ad44-20be920cd8f5."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 50, 49, 57, 48, 53, 49, 57, 45, 57, 56, 100, 48, 45, 52, 99, 52, 49, 45, 97, 100, 52, 52, 45, 50, 48, 98, 101, 57, 50, 48, 99, 100, 56, 102, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_82190519-98d0-4c41-ad44-20be920cd8f5." peer_addr = [fd00:1122:3344:101::3]:62289 req_id = f0b6ba33-718d-489e-ba8a-ea0d7907e4d7