{"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 62390,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_be5f8011-b34e-46e7-9881-b4f33b46d14b.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_be5f8011-b34e-46e7-9881-b4f33b46d14b.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 98,\n 101,\n 53,\n 102,\n 56,\n 48,\n 49,\n 49,\n 45,\n 98,\n 51,\n 52,\n 101,\n 45,\n 52,\n 54,\n 101,\n 55,\n 45,\n 57,\n 56,\n 56,\n 49,\n 45,\n 98,\n 52,\n 102,\n 51,\n 51,\n 98,\n 52,\n 54,\n 100,\n 49,\n 52,\n 98,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_be5f8011-b34e-46e7-9881-b4f33b46d14b.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.693712906Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::7]:38173","req_id":"6598f4ad-7936-4753-9cca-f07c2e250e68","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 62390,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_be5f8011-b34e-46e7-9881-b4f33b46d14b.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_be5f8011-b34e-46e7-9881-b4f33b46d14b.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 98,\n 101,\n 53,\n 102,\n 56,\n 48,\n 49,\n 49,\n 45,\n 98,\n 51,\n 52,\n 101,\n 45,\n 52,\n 54,\n 101,\n 55,\n 45,\n 57,\n 56,\n 56,\n 49,\n 45,\n 98,\n 52,\n 102,\n 51,\n 51,\n 98,\n 52,\n 54,\n 100,\n 49,\n 52,\n 98,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_be5f8011-b34e-46e7-9881-b4f33b46d14b.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.694514702Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::7]:58635","req_id":"7fcbad1d-f9c6-4133-995b-775c31e23fe3","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 24400,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_0c6ca4e2-1302-4ea2-9fec-6f2d3c4538a0.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_0c6ca4e2-1302-4ea2-9fec-6f2d3c4538a0.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 48,\n 99,\n 54,\n 99,\n 97,\n 52,\n 101,\n 50,\n 45,\n 49,\n 51,\n 48,\n 50,\n 45,\n 52,\n 101,\n 97,\n 50,\n 45,\n 57,\n 102,\n 101,\n 99,\n 45,\n 54,\n 102,\n 50,\n 100,\n 51,\n 99,\n 52,\n 53,\n 51,\n 56,\n 97,\n 48,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_0c6ca4e2-1302-4ea2-9fec-6f2d3c4538a0.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.710200473Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::3]:33340","req_id":"a2031364-0482-42e5-b112-a6c8995ae6e7","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 24400,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_0c6ca4e2-1302-4ea2-9fec-6f2d3c4538a0.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_0c6ca4e2-1302-4ea2-9fec-6f2d3c4538a0.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 48,\n 99,\n 54,\n 99,\n 97,\n 52,\n 101,\n 50,\n 45,\n 49,\n 51,\n 48,\n 50,\n 45,\n 52,\n 101,\n 97,\n 50,\n 45,\n 57,\n 102,\n 101,\n 99,\n 45,\n 54,\n 102,\n 50,\n 100,\n 51,\n 99,\n 52,\n 53,\n 51,\n 56,\n 97,\n 48,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_0c6ca4e2-1302-4ea2-9fec-6f2d3c4538a0.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.711026852Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::3]:54548","req_id":"daa9125a-1933-4e21-a754-5438d43f6407","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 65326,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_8839574c-b9aa-4355-9080-e7673032b04f.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_8839574c-b9aa-4355-9080-e7673032b04f.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 56,\n 56,\n 51,\n 57,\n 53,\n 55,\n 52,\n 99,\n 45,\n 98,\n 57,\n 97,\n 97,\n 45,\n 52,\n 51,\n 53,\n 53,\n 45,\n 57,\n 48,\n 56,\n 48,\n 45,\n 101,\n 55,\n 54,\n 55,\n 51,\n 48,\n 51,\n 50,\n 98,\n 48,\n 52,\n 102,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_8839574c-b9aa-4355-9080-e7673032b04f.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.717695355Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::4]:57583","req_id":"f00be800-2956-44a4-8f53-2a2dbd15c31a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 65326,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_8839574c-b9aa-4355-9080-e7673032b04f.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_8839574c-b9aa-4355-9080-e7673032b04f.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 56,\n 56,\n 51,\n 57,\n 53,\n 55,\n 52,\n 99,\n 45,\n 98,\n 57,\n 97,\n 97,\n 45,\n 52,\n 51,\n 53,\n 53,\n 45,\n 57,\n 48,\n 56,\n 48,\n 45,\n 101,\n 55,\n 54,\n 55,\n 51,\n 48,\n 51,\n 50,\n 98,\n 48,\n 52,\n 102,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_8839574c-b9aa-4355-9080-e7673032b04f.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.718332959Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::4]:61567","req_id":"3b4d460d-bfb8-4d45-9fcc-48a42c0cb24f","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33883,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_2611e969-d91b-42fd-afc8-0962b0155fe8.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_2611e969-d91b-42fd-afc8-0962b0155fe8.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 50,\n 54,\n 49,\n 49,\n 101,\n 57,\n 54,\n 57,\n 45,\n 100,\n 57,\n 49,\n 98,\n 45,\n 52,\n 50,\n 102,\n 100,\n 45,\n 97,\n 102,\n 99,\n 56,\n 45,\n 48,\n 57,\n 54,\n 50,\n 98,\n 48,\n 49,\n 53,\n 53,\n 102,\n 101,\n 56,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_2611e969-d91b-42fd-afc8-0962b0155fe8.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.751995209Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::6]:51606","req_id":"6648296a-be56-46cb-8416-d3a1c6f56d20","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33883,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_2611e969-d91b-42fd-afc8-0962b0155fe8.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_2611e969-d91b-42fd-afc8-0962b0155fe8.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 50,\n 54,\n 49,\n 49,\n 101,\n 57,\n 54,\n 57,\n 45,\n 100,\n 57,\n 49,\n 98,\n 45,\n 52,\n 50,\n 102,\n 100,\n 45,\n 97,\n 102,\n 99,\n 56,\n 45,\n 48,\n 57,\n 54,\n 50,\n 98,\n 48,\n 49,\n 53,\n 53,\n 102,\n 101,\n 56,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_2611e969-d91b-42fd-afc8-0962b0155fe8.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.752821384Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::6]:42511","req_id":"5c2f6b39-540e-40d2-b8cc-dfc0dfb2c80c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 35903,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_3952a921-51fe-4911-b2d0-3cc670631fc9.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_3952a921-51fe-4911-b2d0-3cc670631fc9.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 51,\n 57,\n 53,\n 50,\n 97,\n 57,\n 50,\n 49,\n 45,\n 53,\n 49,\n 102,\n 101,\n 45,\n 52,\n 57,\n 49,\n 49,\n 45,\n 98,\n 50,\n 100,\n 48,\n 45,\n 51,\n 99,\n 99,\n 54,\n 55,\n 48,\n 54,\n 51,\n 49,\n 102,\n 99,\n 57,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_3952a921-51fe-4911-b2d0-3cc670631fc9.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.761799444Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::5]:34390","req_id":"e3ca34f7-79dc-458e-ad08-e4a667dcf3d7","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 35903,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_3952a921-51fe-4911-b2d0-3cc670631fc9.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_3952a921-51fe-4911-b2d0-3cc670631fc9.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 51,\n 57,\n 53,\n 50,\n 97,\n 57,\n 50,\n 49,\n 45,\n 53,\n 49,\n 102,\n 101,\n 45,\n 52,\n 57,\n 49,\n 49,\n 45,\n 98,\n 50,\n 100,\n 48,\n 45,\n 51,\n 99,\n 99,\n 54,\n 55,\n 48,\n 54,\n 51,\n 49,\n 102,\n 99,\n 57,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_3952a921-51fe-4911-b2d0-3cc670631fc9.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:00.76251882Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::5]:56332","req_id":"63146b06-5318-43c3-9543-c22dbbadce7d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33260,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:08.251530076Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:62978","req_id":"eb17002d-bc80-411b-80df-28cf2663d473","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43666,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:18.253569944Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:61547","req_id":"1b92150d-b8bf-4378-a6c2-11ca790eb038","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 24750,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:28.255438043Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:64913","req_id":"801f4772-e73a-4807-927a-15bf3d607257","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 42449,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:38.256255239Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:58871","req_id":"c98612c7-390b-4894-a604-59512fb30184","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:47.636461229Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:58784"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:47.637675887Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"3cb77a64-93d9-44c1-96bc-e6b7a719c280","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:47.637707288Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"3cb77a64-93d9-44c1-96bc-e6b7a719c280","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:47.637717538Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"3cb77a64-93d9-44c1-96bc-e6b7a719c280","remote_addr":"[fd00:1122:3344:101::c]:58784","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":165,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 49228,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:48.087677761Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::c]:53894","req_id":"cc7c71a6-e350-4631-833b-33400164bd00","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.216497138Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:59860"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.216771305Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"35bf0daa-d6e8-49b9-b7b4-d8100e6b942c","remote_addr":"[fd00:1122:3344:101::c]:59860","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":223,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 46405,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:48.257271751Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:53532","req_id":"9d6f3b54-f84d-46eb-b2a6-006f6212e74d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 27336,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:48.833046373Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::c]:51059","req_id":"e327b790-1f5e-4900-93f5-18452464e35b","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.92469331Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:47882"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.924948326Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"e2808f52-4aee-4851-83bf-8d62932fe04a","remote_addr":"[fd00:1122:3344:101::c]:47882","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":214,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.951709928Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:34227"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.952867804Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"f1f8219a-b3da-491f-a6a5-cb5c2ec758ee","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.952897955Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"f1f8219a-b3da-491f-a6a5-cb5c2ec758ee","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.952909225Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"f1f8219a-b3da-491f-a6a5-cb5c2ec758ee","remote_addr":"[fd00:1122:3344:101::b]:34227","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":229,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.956398875Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:33592"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.957805057Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"46015342-f651-470a-9ece-f37964a98901","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.957834038Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"46015342-f651-470a-9ece-f37964a98901","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:48.957844968Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"46015342-f651-470a-9ece-f37964a98901","remote_addr":"[fd00:1122:3344:101::a]:33592","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":226,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 40985,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:49.554680503Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::b]:45162","req_id":"98e21531-8cfc-4ce1-96c7-4214d976bb14","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:49.664794112Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:43585"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:49.665020517Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"1d960b3c-22d8-47a1-b6cc-ab2e9b76504c","remote_addr":"[fd00:1122:3344:101::b]:43585","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":192,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 12313,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:50.099489436Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::b]:60079","req_id":"b7b86c56-6425-4e15-b134-59343f7cb396","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 65403,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:50.099581218Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::a]:24665","req_id":"d1297664-8904-4294-8bfa-626b20185be8","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:50.286016623Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:33502"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:50.286260419Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"98d6b932-c668-4b43-9980-5cf5d6c39790","remote_addr":"[fd00:1122:3344:101::a]:33502","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":196,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:50.324142396Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:34173"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:50.324380151Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"2f1e01f3-9eb1-452e-ab8e-ebf72606d728","remote_addr":"[fd00:1122:3344:101::b]:34173","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":202,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 42559,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:50.867127868Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::a]:20995","req_id":"60e7f665-4735-45bc-bf88-5188e75940e1","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:50.963971313Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:54938"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:45:50.964190978Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"6df37ed0-2fe9-4521-b1a0-2701da907dfc","remote_addr":"[fd00:1122:3344:101::a]:54938","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":187,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 27052,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:45:58.258795561Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:64658","req_id":"15071f3c-a215-4ac4-aff7-ee3bcd8b4480","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 37970,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:08.260644427Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:63592","req_id":"c83767b2-1d9c-4bd3-8f66-b63becbb7761","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 64115,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:18.262595211Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:58223","req_id":"ac23fd9b-a4e2-4eff-b99e-56a0a1420362","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 9012,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:28.263900931Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:60886","req_id":"d8d1090e-c06b-40ca-bf7f-e9b39053eed7","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 29277,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:38.265965912Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:49399","req_id":"72c48995-f34d-4358-9ffb-56bacf8147d0","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:47.636140783Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:57425"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:47.637466023Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"709d955b-2667-4913-ab17-9a0784f35f6c","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:47.637493134Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"709d955b-2667-4913-ab17-9a0784f35f6c","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:47.637500884Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"709d955b-2667-4913-ab17-9a0784f35f6c","remote_addr":"[fd00:1122:3344:101::c]:57425","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":168,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 49585,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:48.268296696Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:50263","req_id":"35822251-d4fd-489f-867a-737c2f2ce2a2","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 53637,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:48.77724898Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::c]:35136","req_id":"a0f64b39-166e-4101-b479-87d2750291ce","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.951624358Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:33675"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.952730714Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"4747097e-97ec-4624-a06a-be7011fcdf32","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.952755084Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"4747097e-97ec-4624-a06a-be7011fcdf32","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.952767014Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"4747097e-97ec-4624-a06a-be7011fcdf32","remote_addr":"[fd00:1122:3344:101::b]:33675","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":229,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.956668894Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:40500"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.958454175Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"33121c5e-d2a2-4bbf-8c40-e642a6af2b66","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.958485625Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"33121c5e-d2a2-4bbf-8c40-e642a6af2b66","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.958497425Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"33121c5e-d2a2-4bbf-8c40-e642a6af2b66","remote_addr":"[fd00:1122:3344:101::a]:40500","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":222,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.961067714Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:51493"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:48.961492424Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"20e2049f-ecb4-43b0-929d-10d8739ff039","remote_addr":"[fd00:1122:3344:101::c]:51493","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":267,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32145,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:50.355809391Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::a]:33077","req_id":"9f1e1e9c-1e27-4773-847a-572017138ddb","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 5477,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:50.362612006Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::b]:19428","req_id":"64769eb1-ecda-4a4b-95e2-f67029f5ac64","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:50.45416664Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:38465"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:50.454393336Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"84674dbf-dff2-44b4-9490-20cbb3695945","remote_addr":"[fd00:1122:3344:101::a]:38465","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":190,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:50.488544547Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:44166"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:46:50.488922535Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"ca1d34e1-1102-4205-acb1-79b9afbe43d9","remote_addr":"[fd00:1122:3344:101::b]:44166","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":295,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 9460,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:46:58.270079793Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:56596","req_id":"2e167bb5-7436-4d56-8b21-bd860ffa586b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32587,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:01.377178715Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::1b]:63212","req_id":"071c2a82-33e9-4176-b8cc-dd9fc819f4a6","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 35051,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:01.382050067Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::1b]:32983","req_id":"f2651158-7c77-4b49-a015-54a7f5836931","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 61294,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:01.385848483Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::1b]:55076","req_id":"29811557-799f-4201-8dd2-900b03e5445a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 63828,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:08.271465984Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:63736","req_id":"19773dae-ab34-4452-98cf-46343abae15c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43916,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:18.273570639Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:49601","req_id":"c203926a-880d-4062-b005-a047b71cb462","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 51952,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:28.275295948Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:62621","req_id":"c0e19041-ba75-41d1-a34a-395af1f998ad","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 46817,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:38.276511069Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:54560","req_id":"308b93a8-8a04-4c3d-8d23-0a3366e5eda5","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:47.63796362Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:43513"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:47.639135067Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"421c88ee-db9b-4846-977f-4384a752a7aa","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:47.639161688Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"421c88ee-db9b-4846-977f-4384a752a7aa","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:47.639169828Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"421c88ee-db9b-4846-977f-4384a752a7aa","remote_addr":"[fd00:1122:3344:101::c]:43513","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":229,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 27259,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:48.278536524Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:60677","req_id":"67f9a50a-48ad-40cf-ad5e-74226f446b2c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 7116,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:48.890819131Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::c]:17779","req_id":"74676fc4-5eba-46f1-a5f2-084fc8844739","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:48.956067734Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:42547"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:48.957282561Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:46664"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:48.957629469Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"1556c878-9462-4025-91c8-5e774769f860","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:48.95765387Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"1556c878-9462-4025-91c8-5e774769f860","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:48.95766517Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"1556c878-9462-4025-91c8-5e774769f860","remote_addr":"[fd00:1122:3344:101::b]:42547","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":271,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:48.959115774Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"30495c69-5627-4c6a-b8a9-d706141aa9f3","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:48.959140404Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"30495c69-5627-4c6a-b8a9-d706141aa9f3","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:48.959153134Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"30495c69-5627-4c6a-b8a9-d706141aa9f3","remote_addr":"[fd00:1122:3344:101::a]:46664","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":306,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:49.231487695Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:47072"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:49.231814083Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"c866005e-3cf1-451c-a843-1c276cf6b177","remote_addr":"[fd00:1122:3344:101::c]:47072","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":282,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41200,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:49.953713219Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::a]:14882","req_id":"e3a62d85-9e88-4452-840f-8ac027396a0a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 50578,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:49.95857542Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::b]:12037","req_id":"222921ff-84bf-4d7f-ba6c-8344d8852fe8","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:50.071552835Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:33213"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:50.07177724Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"d80babe9-0f2e-4533-ba86-3eee5c0b5c77","remote_addr":"[fd00:1122:3344:101::a]:33213","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":185,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:50.125922079Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:48830"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:47:50.126155295Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"GET","req_id":"e80baece-40de-4a13-b0cb-2aaf5e3640a2","remote_addr":"[fd00:1122:3344:101::b]:48830","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":193,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 50139,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:47:58.280106614Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:51637","req_id":"004e9838-34b4-4723-9a5c-8fcf344f296b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41172,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:48:08.281322444Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:49308","req_id":"4ed4a27d-895e-4e94-8465-d78080b2aed7","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 941,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:48:18.282898313Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:60752","req_id":"5a67482d-3504-4463-9762-f38f9b3e06ac","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 19393,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:48:28.284866127Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:60339","req_id":"c9d8fdd3-0156-4e8e-a2e1-d0389c2eca05","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 44659,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-04-21T11:48:38.28674532Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"peer_addr":"[fd00:1122:3344:101::d]:63686","req_id":"43766a28-8d43-43ae-953f-dca3c7aa73df","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:48:47.638686043Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:35684"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:48:47.640217208Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"a3db00e8-5644-4435-8460-439c9b39675f","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:48:47.640248789Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"new_generation":1,"req_id":"a3db00e8-5644-4435-8460-439c9b39675f","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-04-21T11:48:47.640258609Z","hostname":"oxz_internal_dns_b310b5c7-5f6e-45bc-99f6-2287ef7fcebd","pid":5492,"uri":"/config","method":"PUT","req_id":"a3db00e8-5644-4435-8460-439c9b39675f","remote_addr":"[fd00:1122:3344:101::c]:35684","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":205,"response_code":204}