{"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 49219,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:45:12.643913174Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:51533","req_id":"56f004dc-0a3c-423e-b207-3db8eaa6e89d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 11310,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:45:22.646023819Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:64072","req_id":"36ec1412-4b48-4613-80fc-0bf322b99c4c","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:31.32036219Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:42775"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:31.430393871Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"a749f3e8-3134-4f64-b86e-8521209849a0","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:31.430430892Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"a749f3e8-3134-4f64-b86e-8521209849a0","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:31.430440552Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"a749f3e8-3134-4f64-b86e-8521209849a0","remote_addr":"[fd00:1122:3344:101::c]:42775","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":165,"response_code":"204"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:32.475341659Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:39004"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:32.513884306Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:42618"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:32.59568163Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"f7f420b0-f977-4555-8149-11100837e40f","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:32.595726551Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"f7f420b0-f977-4555-8149-11100837e40f","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:32.595738181Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"f7f420b0-f977-4555-8149-11100837e40f","remote_addr":"[fd00:1122:3344:101::b]:42618","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":158,"response_code":"204"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:32.598898865Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"a20e5fcb-bbaf-49e6-bc9e-bb0271e14391","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:32.598916445Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"a20e5fcb-bbaf-49e6-bc9e-bb0271e14391","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:45:32.598923356Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"a20e5fcb-bbaf-49e6-bc9e-bb0271e14391","remote_addr":"[fd00:1122:3344:101::a]:39004","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":90,"response_code":"204"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28750,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:45:32.647625219Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:51097","req_id":"06e27c00-55fd-41c5-a6eb-56883c5d831b","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 24314,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:45:42.649759313Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:65417","req_id":"3168af1f-f4af-4f73-9b12-2fa75cad466e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43384,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:45:52.651687602Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:51929","req_id":"cb42f991-2fbf-475e-9ee9-c75493d356b6","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 18721,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:02.654289407Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:54077","req_id":"b36f517b-067b-415b-b6f1-4bb77873b88d","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 59912,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:12.655257333Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:50036","req_id":"e6252fc7-6526-4e57-87ef-6c7587de7798","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 951,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:22.655909822Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:50243","req_id":"931e2bdb-fbab-42d8-84e5-983e46d5af22","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:31.466555493Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:45452"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:31.507196059Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"3ed86ea7-b65a-44cf-820f-83638223585b","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:31.50724266Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"3ed86ea7-b65a-44cf-820f-83638223585b","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:31.507267591Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"3ed86ea7-b65a-44cf-820f-83638223585b","remote_addr":"[fd00:1122:3344:101::c]:45452","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":183,"response_code":"204"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:32.542852352Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:50835"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 14231,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:32.65704792Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:62165","req_id":"4c5a465b-72d9-4027-80f3-2900d06a802b","component":"dns"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:32.675595131Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"fd99da75-ba7c-4a23-acc2-a0b6aa4b873d","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:32.675618512Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"fd99da75-ba7c-4a23-acc2-a0b6aa4b873d","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:32.675626872Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"fd99da75-ba7c-4a23-acc2-a0b6aa4b873d","remote_addr":"[fd00:1122:3344:101::a]:50835","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":137,"response_code":"204"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:32.889244694Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:44135"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:32.965634161Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"e8b4f764-4e9d-4997-93f7-4dd2468ed2bb","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:32.965673782Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"e8b4f764-4e9d-4997-93f7-4dd2468ed2bb","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:46:32.965685933Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"e8b4f764-4e9d-4997-93f7-4dd2468ed2bb","remote_addr":"[fd00:1122:3344:101::b]:44135","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":162,"response_code":"204"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 43979,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:42.658819615Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:52919","req_id":"242f2155-02b5-4d1b-a061-019799b44336","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 24610,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:51.179198402Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::1b]:46035","req_id":"c2d40845-2679-4da5-8300-acb04ac16235","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16995,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: AAAA,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:51.183619055Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::1b]:45450","req_id":"0f7a9fcc-d953-482b-8404-44e96b5e3112","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 40691,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"0.pool.ntp.org.\"),\n ),\n original: Query {\n name: Name(\"0.pool.ntp.org.\"),\n query_type: A,\n query_class: IN,\n },\n },\n original: [\n 1,\n 48,\n 4,\n 112,\n 111,\n 111,\n 108,\n 3,\n 110,\n 116,\n 112,\n 3,\n 111,\n 114,\n 103,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:51.187591227Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::1b]:37163","req_id":"ade4b1fa-5986-4580-be59-057b64bab325","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 25604,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:46:52.660760992Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:54375","req_id":"022bafbb-5991-40c2-9450-04bbbf691802","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 24681,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:47:02.662793794Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:55491","req_id":"7e93edfa-96f9-4aa7-9c77-ba5ace27d6aa","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 17993,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:47:12.66420767Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:65058","req_id":"9901e95d-4080-4ca2-9821-77dddf95f56a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28894,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:47:22.665760749Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:55401","req_id":"7f0be746-e20b-4109-b87f-eefeaab20741","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:31.337630491Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:58856"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:31.563827086Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"9f7b27ff-4ebb-483b-95d1-42539f1215aa","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:31.563878617Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"9f7b27ff-4ebb-483b-95d1-42539f1215aa","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:31.563910747Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"9f7b27ff-4ebb-483b-95d1-42539f1215aa","remote_addr":"[fd00:1122:3344:101::c]:58856","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":143,"response_code":"204"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:32.466843561Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:55061"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:32.524033752Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:47257"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:32.575003058Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"17adfc6f-ebc7-4212-871f-96ebc8e7c9e4","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:32.575041689Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"17adfc6f-ebc7-4212-871f-96ebc8e7c9e4","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:32.5750515Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"17adfc6f-ebc7-4212-871f-96ebc8e7c9e4","remote_addr":"[fd00:1122:3344:101::b]:55061","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":151,"response_code":"204"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:32.641824814Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"3d1a9454-63ab-4864-b7bb-a70bbc0e36f5","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:32.641852874Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"3d1a9454-63ab-4864-b7bb-a70bbc0e36f5","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:47:32.641861354Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"3d1a9454-63ab-4864-b7bb-a70bbc0e36f5","remote_addr":"[fd00:1122:3344:101::a]:47257","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":125,"response_code":"204"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 21966,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:47:32.667605943Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:57580","req_id":"0372f9fd-559b-44fc-aa04-32547508803f","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28628,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:47:42.669387498Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:56478","req_id":"3e071866-c479-42c7-a290-fd933b383f7e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 63639,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:47:52.671374758Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:54622","req_id":"a8826386-10e9-47dd-8601-593520b976dd","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 37147,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:02.67339712Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:64991","req_id":"f763cc93-61db-4a7c-ab6d-ae1b672d414a","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 16466,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:12.675241015Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:52532","req_id":"222b92c9-56e2-453a-bae6-e091d0eaa813","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41511,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:22.677198085Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:60149","req_id":"685b5f8e-9617-440b-9b0a-5831044e6a41","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:31.479972213Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:55439"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 36746,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:31.520128657Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::c]:63929","req_id":"0b783d84-65ac-4f2d-a0f9-e3a554eacb22","component":"dns"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:31.56537959Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"0a4f1d8d-c799-4387-805f-d34b8e911e30","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:31.565400771Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"0a4f1d8d-c799-4387-805f-d34b8e911e30","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:31.565411121Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"0a4f1d8d-c799-4387-805f-d34b8e911e30","remote_addr":"[fd00:1122:3344:101::c]:55439","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":146,"response_code":"204"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:32.605838735Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:47947"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:32.627144131Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:43269"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 3853,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:32.679312515Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:62163","req_id":"25b54dce-63d9-4fed-9ded-6b06221ac10e","component":"dns"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:32.698982723Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"88422064-4bca-46c8-983f-5917e0e980ba","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:32.699021253Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"88422064-4bca-46c8-983f-5917e0e980ba","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:32.699033834Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"88422064-4bca-46c8-983f-5917e0e980ba","remote_addr":"[fd00:1122:3344:101::a]:47947","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":143,"response_code":"204"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 15412,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:32.714910203Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::a]:51719","req_id":"2bf2f712-97fe-4523-aad5-3a58e78437ea","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 32319,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:32.749065518Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::b]:49620","req_id":"91441e18-65f0-47dc-9389-3567f9f99d65","component":"dns"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:32.758046097Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"589b54f9-cbfa-46b9-83d7-58793a4a32d7","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:32.758067148Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"589b54f9-cbfa-46b9-83d7-58793a4a32d7","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:48:32.758073708Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"589b54f9-cbfa-46b9-83d7-58793a4a32d7","remote_addr":"[fd00:1122:3344:101::b]:43269","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":144,"response_code":"204"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 18980,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:42.681142094Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:62759","req_id":"ce3ce78d-52ac-4ca2-ab21-920a4115cf38","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 52884,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:48:52.683362909Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:59202","req_id":"65d638c9-b4f5-4a1a-b47f-1055b79b547e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 14017,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:49:02.684962829Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:62579","req_id":"6302950a-de1c-43a6-8ee5-deed208c3778","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 18512,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:49:12.687404798Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:56349","req_id":"94cde40e-785a-445c-be5c-f72cde945289","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 37746,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:49:22.688738573Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:65010","req_id":"2ee2abd9-720a-40b4-99ad-25765965244b","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:31.499859519Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:60285"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:31.649244585Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"68ad4169-6e99-425f-b2ce-60cccaa9c4ca","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:31.649282716Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"68ad4169-6e99-425f-b2ce-60cccaa9c4ca","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:31.649293036Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"68ad4169-6e99-425f-b2ce-60cccaa9c4ca","remote_addr":"[fd00:1122:3344:101::c]:60285","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":190,"response_code":"204"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:32.578987592Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:34069"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:32.673315187Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:52087"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57276,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:49:32.689885243Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:52178","req_id":"178c5ae2-5dc6-49c7-a289-f74512eba959","component":"dns"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:32.747161316Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"3bf5b251-9119-42a4-98e3-a2aac6721107","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:32.747188246Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"3bf5b251-9119-42a4-98e3-a2aac6721107","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:32.747199697Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"3bf5b251-9119-42a4-98e3-a2aac6721107","remote_addr":"[fd00:1122:3344:101::a]:52087","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":134,"response_code":"204"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:32.751922646Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"8154686d-472a-4202-ae04-3538bc46635a","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:32.751941547Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"8154686d-472a-4202-ae04-3538bc46635a","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:49:32.751949857Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"8154686d-472a-4202-ae04-3538bc46635a","remote_addr":"[fd00:1122:3344:101::b]:34069","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":93,"response_code":"204"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 30110,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:49:42.691945874Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:50361","req_id":"92cceba5-836e-4516-92bc-6cc4e2a90b58","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 4091,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:49:52.693541773Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:53737","req_id":"307fdbbc-a4ad-4e95-93fc-46161235626c","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 27450,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:50:02.694933408Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:56917","req_id":"6090204e-2862-45ad-a0d5-01eb2ec5fde5","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 29395,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:50:12.696267362Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:61549","req_id":"fcc761d9-51aa-4c9b-94c8-add49116a1d5","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 11306,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:50:22.69766206Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:56146","req_id":"3fc2de28-d0c8-4eb3-937b-454478b22422","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:31.406973025Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:64020"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:31.48067581Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"e40208f4-fe48-4c6f-af1d-136ec679d1ae","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:31.480721201Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"e40208f4-fe48-4c6f-af1d-136ec679d1ae","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:31.480732431Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"e40208f4-fe48-4c6f-af1d-136ec679d1ae","remote_addr":"[fd00:1122:3344:101::c]:64020","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":146,"response_code":"204"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:32.467170598Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:55612"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:32.475166884Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:37291"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:32.551954812Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"e41f3aa3-ee08-4e67-9991-7f7929f128e8","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:32.551996103Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"e41f3aa3-ee08-4e67-9991-7f7929f128e8","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:32.552006593Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"e41f3aa3-ee08-4e67-9991-7f7929f128e8","remote_addr":"[fd00:1122:3344:101::b]:37291","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":148,"response_code":"204"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:32.575601572Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"c7c631f3-a3fa-4683-bfc0-0e75c2267b97","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:32.575629343Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"new_generation":1,"req_id":"c7c631f3-a3fa-4683-bfc0-0e75c2267b97","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2025-04-18T21:50:32.575639783Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"uri":"/config","method":"PUT","req_id":"c7c631f3-a3fa-4683-bfc0-0e75c2267b97","remote_addr":"[fd00:1122:3344:101::a]:55612","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":103,"response_code":"204"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 40843,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:50:32.700045348Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:51402","req_id":"d23f22d2-ca6f-4dda-b755-145aead44a81","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 54004,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n query: WireQuery {\n query: LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n dnssec_ok: false,\n max_payload: 1232,\n options: OPT {\n options: {},\n },\n },\n ),\n} NXDOMAIN: no records found for name: \"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"","v":0,"name":"dns-server","level":50,"time":"2025-04-18T21:50:42.70164982Z","hostname":"oxz_internal_dns_64dc287e-3ce7-44b1-aa87-7047cdac838f","pid":5220,"peer_addr":"[fd00:1122:3344:101::d]:52621","req_id":"87248fd2-55c9-4186-8c51-f8c5a3754063","component":"dns"}