{"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 51432,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_ntp_0b3b54cf-c086-4a2a-a8b0-0e5d5704ec86.\"),\n ),\n original: Query {\n name: Name(\"oxz_ntp_0b3b54cf-c086-4a2a-a8b0-0e5d5704ec86.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 44,\n 111,\n 120,\n 122,\n 95,\n 110,\n 116,\n 112,\n 95,\n 48,\n 98,\n 51,\n 98,\n 53,\n 52,\n 99,\n 102,\n 45,\n 99,\n 48,\n 56,\n 54,\n 45,\n 52,\n 97,\n 50,\n 97,\n 45,\n 97,\n 56,\n 98,\n 48,\n 45,\n 48,\n 101,\n 53,\n 100,\n 53,\n 55,\n 48,\n 52,\n 101,\n 99,\n 56,\n 54,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_ntp_0b3b54cf-c086-4a2a-a8b0-0e5d5704ec86.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:00.744698204Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::1b]:64436","req_id":"4298fb3a-1dee-44e9-867c-994901ddea47","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 18398,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_clickhouse_844545fa-1efe-4ce8-9b7d-e1916d419b19.\"),\n ),\n original: Query {\n name: Name(\"oxz_clickhouse_844545fa-1efe-4ce8-9b7d-e1916d419b19.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 51,\n 111,\n 120,\n 122,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 95,\n 56,\n 52,\n 52,\n 53,\n 52,\n 53,\n 102,\n 97,\n 45,\n 49,\n 101,\n 102,\n 101,\n 45,\n 52,\n 99,\n 101,\n 56,\n 45,\n 57,\n 98,\n 55,\n 100,\n 45,\n 101,\n 49,\n 57,\n 49,\n 54,\n 100,\n 52,\n 49,\n 57,\n 98,\n 49,\n 57,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_clickhouse_844545fa-1efe-4ce8-9b7d-e1916d419b19.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:00.837815019Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::e]:62084","req_id":"8afeb15b-3826-4dcf-944f-b7f0f394a814","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 18398,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_clickhouse_844545fa-1efe-4ce8-9b7d-e1916d419b19.\"),\n ),\n original: Query {\n name: Name(\"oxz_clickhouse_844545fa-1efe-4ce8-9b7d-e1916d419b19.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 51,\n 111,\n 120,\n 122,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 95,\n 56,\n 52,\n 52,\n 53,\n 52,\n 53,\n 102,\n 97,\n 45,\n 49,\n 101,\n 102,\n 101,\n 45,\n 52,\n 99,\n 101,\n 56,\n 45,\n 57,\n 98,\n 55,\n 100,\n 45,\n 101,\n 49,\n 57,\n 49,\n 54,\n 100,\n 52,\n 49,\n 57,\n 98,\n 49,\n 57,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_clickhouse_844545fa-1efe-4ce8-9b7d-e1916d419b19.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:00.838587398Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::e]:35350","req_id":"2c6ee596-411c-4f5d-a741-cf15d9041c6d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 55676,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_fbe1a77c-b0c8-483c-aca7-3be5e1a35d61.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_fbe1a77c-b0c8-483c-aca7-3be5e1a35d61.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 102,\n 98,\n 101,\n 49,\n 97,\n 55,\n 55,\n 99,\n 45,\n 98,\n 48,\n 99,\n 56,\n 45,\n 52,\n 56,\n 51,\n 99,\n 45,\n 97,\n 99,\n 97,\n 55,\n 45,\n 51,\n 98,\n 101,\n 53,\n 101,\n 49,\n 97,\n 51,\n 53,\n 100,\n 54,\n 49,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_fbe1a77c-b0c8-483c-aca7-3be5e1a35d61.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:00.858504923Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::4]:42696","req_id":"45be2784-7fc9-4f2e-b8d6-d0b4ea808855","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 55676,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_fbe1a77c-b0c8-483c-aca7-3be5e1a35d61.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_fbe1a77c-b0c8-483c-aca7-3be5e1a35d61.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 102,\n 98,\n 101,\n 49,\n 97,\n 55,\n 55,\n 99,\n 45,\n 98,\n 48,\n 99,\n 56,\n 45,\n 52,\n 56,\n 51,\n 99,\n 45,\n 97,\n 99,\n 97,\n 55,\n 45,\n 51,\n 98,\n 101,\n 53,\n 101,\n 49,\n 97,\n 51,\n 53,\n 100,\n 54,\n 49,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_fbe1a77c-b0c8-483c-aca7-3be5e1a35d61.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:00.85908858Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::4]:44657","req_id":"2d266531-efc3-4272-9476-49697074cf0e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 11406,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_c1117bdd-450d-4784-9528-e72f8211e8f5.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_c1117bdd-450d-4784-9528-e72f8211e8f5.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 99,\n 49,\n 49,\n 49,\n 55,\n 98,\n 100,\n 100,\n 45,\n 52,\n 53,\n 48,\n 100,\n 45,\n 52,\n 55,\n 56,\n 52,\n 45,\n 57,\n 53,\n 50,\n 56,\n 45,\n 101,\n 55,\n 50,\n 102,\n 56,\n 50,\n 49,\n 49,\n 101,\n 56,\n 102,\n 53,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_c1117bdd-450d-4784-9528-e72f8211e8f5.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:01.061397898Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::6]:65039","req_id":"2c4c78c1-5cb8-4c76-a47a-09254f77e3c2","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 11406,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_c1117bdd-450d-4784-9528-e72f8211e8f5.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_c1117bdd-450d-4784-9528-e72f8211e8f5.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 99,\n 49,\n 49,\n 49,\n 55,\n 98,\n 100,\n 100,\n 45,\n 52,\n 53,\n 48,\n 100,\n 45,\n 52,\n 55,\n 56,\n 52,\n 45,\n 57,\n 53,\n 50,\n 56,\n 45,\n 101,\n 55,\n 50,\n 102,\n 56,\n 50,\n 49,\n 49,\n 101,\n 56,\n 102,\n 53,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_c1117bdd-450d-4784-9528-e72f8211e8f5.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:01.062003765Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::6]:59986","req_id":"73b55e55-2589-4a88-a765-38543ddf474d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 64408,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_4e0f49f2-5897-4b83-bc4e-da213c0a7da9.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_4e0f49f2-5897-4b83-bc4e-da213c0a7da9.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 52,\n 101,\n 48,\n 102,\n 52,\n 57,\n 102,\n 50,\n 45,\n 53,\n 56,\n 57,\n 55,\n 45,\n 52,\n 98,\n 56,\n 51,\n 45,\n 98,\n 99,\n 52,\n 101,\n 45,\n 100,\n 97,\n 50,\n 49,\n 51,\n 99,\n 48,\n 97,\n 55,\n 100,\n 97,\n 57,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_4e0f49f2-5897-4b83-bc4e-da213c0a7da9.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:01.143845771Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::3]:55055","req_id":"29a1ecbb-1395-4143-9efe-a4700910c081","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 64408,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_4e0f49f2-5897-4b83-bc4e-da213c0a7da9.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_4e0f49f2-5897-4b83-bc4e-da213c0a7da9.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 52,\n 101,\n 48,\n 102,\n 52,\n 57,\n 102,\n 50,\n 45,\n 53,\n 56,\n 57,\n 55,\n 45,\n 52,\n 98,\n 56,\n 51,\n 45,\n 98,\n 99,\n 52,\n 101,\n 45,\n 100,\n 97,\n 50,\n 49,\n 51,\n 99,\n 48,\n 97,\n 55,\n 100,\n 97,\n 57,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_4e0f49f2-5897-4b83-bc4e-da213c0a7da9.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:01.144372368Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::3]:55155","req_id":"80b2ccc4-db10-4e0c-84e7-4eac2c4b9f6f","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 5752,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_cfffc35e-c038-4d4d-bdab-d0d52f53ad03.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_cfffc35e-c038-4d4d-bdab-d0d52f53ad03.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 99,\n 102,\n 102,\n 102,\n 99,\n 51,\n 53,\n 101,\n 45,\n 99,\n 48,\n 51,\n 56,\n 45,\n 52,\n 100,\n 52,\n 100,\n 45,\n 98,\n 100,\n 97,\n 98,\n 45,\n 100,\n 48,\n 100,\n 53,\n 50,\n 102,\n 53,\n 51,\n 97,\n 100,\n 48,\n 51,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_cfffc35e-c038-4d4d-bdab-d0d52f53ad03.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:01.236149036Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::5]:61386","req_id":"e70259e1-9138-426c-a2b4-73c640580c41","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 5752,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_cfffc35e-c038-4d4d-bdab-d0d52f53ad03.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_cfffc35e-c038-4d4d-bdab-d0d52f53ad03.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 99,\n 102,\n 102,\n 102,\n 99,\n 51,\n 53,\n 101,\n 45,\n 99,\n 48,\n 51,\n 56,\n 45,\n 52,\n 100,\n 52,\n 100,\n 45,\n 98,\n 100,\n 97,\n 98,\n 45,\n 100,\n 48,\n 100,\n 53,\n 50,\n 102,\n 53,\n 51,\n 97,\n 100,\n 48,\n 51,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_cfffc35e-c038-4d4d-bdab-d0d52f53ad03.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:01.236628302Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::5]:48441","req_id":"7f807534-1bfe-4d55-a174-c54ad37e04d9","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 14056,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_f5bb06b2-ab8f-4dcd-b813-f58f6e0c6f19.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_f5bb06b2-ab8f-4dcd-b813-f58f6e0c6f19.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 102,\n 53,\n 98,\n 98,\n 48,\n 54,\n 98,\n 50,\n 45,\n 97,\n 98,\n 56,\n 102,\n 45,\n 52,\n 100,\n 99,\n 100,\n 45,\n 98,\n 56,\n 49,\n 51,\n 45,\n 102,\n 53,\n 56,\n 102,\n 54,\n 101,\n 48,\n 99,\n 54,\n 102,\n 49,\n 57,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_f5bb06b2-ab8f-4dcd-b813-f58f6e0c6f19.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:01.240631761Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::7]:57452","req_id":"c74011e7-3e68-4956-ac06-6d3e12803cb0","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 14056,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_f5bb06b2-ab8f-4dcd-b813-f58f6e0c6f19.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_f5bb06b2-ab8f-4dcd-b813-f58f6e0c6f19.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 102,\n 53,\n 98,\n 98,\n 48,\n 54,\n 98,\n 50,\n 45,\n 97,\n 98,\n 56,\n 102,\n 45,\n 52,\n 100,\n 99,\n 100,\n 45,\n 98,\n 56,\n 49,\n 51,\n 45,\n 102,\n 53,\n 56,\n 102,\n 54,\n 101,\n 48,\n 99,\n 54,\n 102,\n 49,\n 57,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_f5bb06b2-ab8f-4dcd-b813-f58f6e0c6f19.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:01.241010436Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::7]:65355","req_id":"f7bf5477-a3a2-4c71-a23d-c89170c84481","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 54424,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:09.846851393Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:63946","req_id":"1d081584-be8b-43db-891b-ad2ec5561b62","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 9542,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:19.848989657Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:55859","req_id":"e2da09c2-1fdb-4327-b664-b7e50895342e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 1044,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:29.851061791Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:51976","req_id":"a5ba0d48-82d2-41ca-bbd5-75dded7b6766","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 42635,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:39.853262415Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:59315","req_id":"be5e5eb0-40fd-460d-ba90-fdfb4b2360c7","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 24097,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:49.855557893Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:65402","req_id":"8941286a-8158-419f-b05f-773e473e4b5b","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:51.404072962Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:51828"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:51.435468928Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:59938"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 49897,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:51.638617685Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::b]:62992","req_id":"766130c0-4364-4d53-9366-94764ad22e5e","component":"dns"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:51.878203171Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"e176e834-d932-4f08-925a-4cc051728031","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:51.878252632Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"e176e834-d932-4f08-925a-4cc051728031","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:51.878261652Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"e176e834-d932-4f08-925a-4cc051728031","remote_addr":"[fd00:1122:3344:101::b]:59938","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":290,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 15957,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:51.926592246Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::a]:50927","req_id":"66a3561e-5e6d-4518-8a5b-1e846d07996c","component":"dns"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:51.941117525Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"5d203140-8ac6-47e1-8839-4733cae6151a","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:51.941159595Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"5d203140-8ac6-47e1-8839-4733cae6151a","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:51.941172045Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"5d203140-8ac6-47e1-8839-4733cae6151a","remote_addr":"[fd00:1122:3344:101::a]:51828","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":231,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:52.124021293Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:55713"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:52.49214024Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"80e9cab9-8cc9-4b9e-bce4-1921688ac6ba","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:52.49217162Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"80e9cab9-8cc9-4b9e-bce4-1921688ac6ba","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:45:52.49217992Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"80e9cab9-8cc9-4b9e-bce4-1921688ac6ba","remote_addr":"[fd00:1122:3344:101::c]:55713","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":194,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 8514,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:54.000640866Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::c]:63131","req_id":"1d156529-092a-4e79-8633-87ec9e073d00","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 53022,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:45:59.857617646Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:49161","req_id":"0d62a700-f306-4ced-bf78-ce01364f9416","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 58561,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:09.859308755Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:49473","req_id":"b78223e5-77d5-4f4e-ae63-5429644a8385","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57644,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:19.860862533Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:59943","req_id":"dd6c4a2a-0b9b-4288-8348-cb1d6599fb46","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 56185,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:28.063752026Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::1b]:57296","req_id":"5802eec6-8977-401a-9ca8-103e7b5ad3c8","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41970,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:28.069590118Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::1b]:48631","req_id":"12c9d209-6df3-4dd0-96ee-b0910a0ba292","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33751,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:28.074415327Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::1b]:36804","req_id":"36f13934-ab9e-4d1c-b7bc-af02eea1c58a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 64915,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:29.862984407Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:64050","req_id":"9177ca4f-6aa3-4b3b-88f0-26d593cdfec8","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 12197,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:39.864808087Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:59607","req_id":"b1603bb2-80e0-4e00-ada9-488424164aeb","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 10903,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:49.866459526Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:52179","req_id":"57fb7c57-fea6-4f21-b94b-4e61e413deaa","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:51.440082874Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:37510"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:51.475336197Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:36484"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:51.724821004Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"06087709-37da-47d6-852f-4c480975dc06","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:51.724864315Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"06087709-37da-47d6-852f-4c480975dc06","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:51.724873115Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"06087709-37da-47d6-852f-4c480975dc06","remote_addr":"[fd00:1122:3344:101::a]:36484","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":182,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:51.83595975Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"8ffa1de9-b6f5-43ec-9b99-b38ede321ccb","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:51.836018951Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"8ffa1de9-b6f5-43ec-9b99-b38ede321ccb","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:51.836033562Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"8ffa1de9-b6f5-43ec-9b99-b38ede321ccb","remote_addr":"[fd00:1122:3344:101::b]:37510","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":251,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:52.066996541Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:59002"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:52.430310088Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"09abf097-94c0-47a3-b0d0-3542252c0c2b","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:52.430340769Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"09abf097-94c0-47a3-b0d0-3542252c0c2b","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:46:52.430349049Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"09abf097-94c0-47a3-b0d0-3542252c0c2b","remote_addr":"[fd00:1122:3344:101::c]:59002","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":174,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 6060,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:46:59.868054003Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:60299","req_id":"83d026c6-9ac2-4dc4-bbad-856ec1687670","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16158,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:47:09.869297126Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:54803","req_id":"2fcbf1b0-4047-4f19-a625-91c70f439c35","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 27986,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:47:19.870023503Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:58474","req_id":"0a35ae81-0ba6-4e2c-98ab-1efe489c13cc","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26533,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:47:29.871225276Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:56184","req_id":"c43c46b1-3cbb-4b70-a337-cd49ff25592c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 21710,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:47:39.872212486Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:50284","req_id":"2795cf33-9d42-410f-9170-71425fe84320","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16930,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:47:49.873902406Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:62681","req_id":"8432199f-121d-4508-9a22-b47401a37996","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.378407404Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:36754"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.605231472Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:33944"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.656636484Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"6e9de47a-8d7b-4dfe-b53d-1fe2e7e03adc","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.656669084Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"6e9de47a-8d7b-4dfe-b53d-1fe2e7e03adc","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.656676914Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"6e9de47a-8d7b-4dfe-b53d-1fe2e7e03adc","remote_addr":"[fd00:1122:3344:101::a]:36754","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":231,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.800349871Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"322c0458-7745-44af-9706-43e6736642f5","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.800391931Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"322c0458-7745-44af-9706-43e6736642f5","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.800402732Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"322c0458-7745-44af-9706-43e6736642f5","remote_addr":"[fd00:1122:3344:101::b]:33944","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":197,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:51.996352771Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:58128"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:52.297272911Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"02611055-de5d-47e6-bc17-14167923abbb","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:52.297332922Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"02611055-de5d-47e6-bc17-14167923abbb","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:47:52.297345962Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"02611055-de5d-47e6-bc17-14167923abbb","remote_addr":"[fd00:1122:3344:101::c]:58128","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":253,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57902,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:47:59.875614265Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:49477","req_id":"38caa604-059f-4cd3-8ed7-7b6cab911dea","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16555,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:48:09.876980629Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:58624","req_id":"7ccd98ef-3c10-47ef-a9c1-746af265b421","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 4484,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:48:19.878999603Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:61628","req_id":"7b460177-da09-4df0-9044-b12fe07adaac","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 64198,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:48:29.88054152Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:56011","req_id":"39839260-08ae-4ecb-b2b8-de413872c490","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 24503,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:48:39.882327399Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:55796","req_id":"e003a96b-975e-4e1c-8035-9b344a3e5ae8","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 6081,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:48:49.88411684Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:62306","req_id":"63e99d42-3d35-4bda-aa1d-abf01c69a29f","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.448877398Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:57209"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.590790233Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:50304"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.704222867Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"f6e2f572-5e47-4d70-a888-0880d3dd0214","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.704255048Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"f6e2f572-5e47-4d70-a888-0880d3dd0214","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.704263068Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"f6e2f572-5e47-4d70-a888-0880d3dd0214","remote_addr":"[fd00:1122:3344:101::a]:57209","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":173,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.921233816Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:55768"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.940753966Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"b3213c3a-9391-4bfd-b0cc-2d59b47a570c","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.940785096Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"b3213c3a-9391-4bfd-b0cc-2d59b47a570c","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:51.940793776Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"b3213c3a-9391-4bfd-b0cc-2d59b47a570c","remote_addr":"[fd00:1122:3344:101::b]:50304","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":225,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:52.261294057Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"b05d8662-10d6-4edf-a902-0f9cad7d3306","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:52.261343908Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"b05d8662-10d6-4edf-a902-0f9cad7d3306","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:48:52.261352777Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"b05d8662-10d6-4edf-a902-0f9cad7d3306","remote_addr":"[fd00:1122:3344:101::c]:55768","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":172,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57388,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:48:59.88594672Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:51215","req_id":"b49d3762-6938-45f3-8626-cf0a3b45a1dc","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28654,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:49:09.887568598Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:52751","req_id":"e45bc979-fe3d-47fa-bb69-e1b9c16398a6","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 33110,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:49:19.890004594Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:52812","req_id":"19f39cbb-1811-4028-8fae-66456e07852b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 50075,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:49:29.892140308Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:53493","req_id":"82c1dffb-d391-4839-957f-72113e7437d4","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 58813,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:49:39.89328237Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:59615","req_id":"6619321c-dfc7-43fe-af8d-b17dbf14fb3c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 52993,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:49:49.894959268Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:61639","req_id":"f261a0a2-f15e-4fd3-9b5b-08d65aa14822","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:51.498290141Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:43781"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:51.580723055Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:47934"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:51.81946902Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"54784ba6-108b-430a-ae80-d7b07cd31dde","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:51.81952241Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"54784ba6-108b-430a-ae80-d7b07cd31dde","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:51.81953358Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"54784ba6-108b-430a-ae80-d7b07cd31dde","remote_addr":"[fd00:1122:3344:101::b]:43781","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":274,"response_code":204} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:51.880224036Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"a55e8635-1845-4c0b-ae33-b046d75be124","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:51.880268127Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"a55e8635-1845-4c0b-ae33-b046d75be124","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:51.880277597Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"a55e8635-1845-4c0b-ae33-b046d75be124","remote_addr":"[fd00:1122:3344:101::a]:47934","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":246,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:52.04316036Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:35681"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:52.285037254Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"84df53fe-d6fc-454e-b3e1-56cd863e2844","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:52.285081125Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"new_generation":1,"req_id":"84df53fe-d6fc-454e-b3e1-56cd863e2844","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-06-04T15:49:52.285091485Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"uri":"/config","method":"PUT","req_id":"84df53fe-d6fc-454e-b3e1-56cd863e2844","remote_addr":"[fd00:1122:3344:101::c]:35681","local_addr":"[fd00:1122:3344:1::1]:5353","component":"http","latency_us":232,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 47834,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:49:59.89610737Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:63214","req_id":"d3da1e16-2db8-4283-a4d3-ad90924725bd","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28738,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:50:09.897760599Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:64273","req_id":"c211fcf4-9796-4dc0-945b-488e59210f76","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32862,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:50:19.899216455Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:57545","req_id":"1522db1a-fa29-4f5d-9569-6b77ff7465a0","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 54251,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:50:28.280702254Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::1b]:50439","req_id":"d1971b64-0013-478f-a956-e454d7f2172a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41146,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:50:28.285112288Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::1b]:61216","req_id":"0737bca6-5d74-4c89-83e2-b3e185f1248c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 29074,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:50:28.289673364Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::1b]:47226","req_id":"95534de6-6013-4876-80ad-dc3d7f56b04c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 47510,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:50:29.900708021Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:58051","req_id":"708c5129-09cb-4ff7-a949-5acc7956aeb6","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 35903,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2025-06-04T15:50:39.903114059Z","hostname":"oxz_internal_dns_6d97642c-17fd-4803-bc28-7ad83219ce8c","pid":5200,"peer_addr":"[fd00:1122:3344:101::d]:54118","req_id":"aeb94693-9b00-462d-8e9f-e63323f2c635","component":"dns"}