{"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 22229,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_ntp_dbaba614-cd0d-4746-96ac-7cb678597d6f.\"),\n ),\n original: Query {\n name: Name(\"oxz_ntp_dbaba614-cd0d-4746-96ac-7cb678597d6f.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 44,\n 111,\n 120,\n 122,\n 95,\n 110,\n 116,\n 112,\n 95,\n 100,\n 98,\n 97,\n 98,\n 97,\n 54,\n 49,\n 52,\n 45,\n 99,\n 100,\n 48,\n 100,\n 45,\n 52,\n 55,\n 52,\n 54,\n 45,\n 57,\n 54,\n 97,\n 99,\n 45,\n 55,\n 99,\n 98,\n 54,\n 55,\n 56,\n 53,\n 57,\n 55,\n 100,\n 54,\n 102,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_ntp_dbaba614-cd0d-4746-96ac-7cb678597d6f.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.355729448Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::1b]:51329","req_id":"0f3d51be-a8b2-4673-8eed-2432786aefc7","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26651,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_clickhouse_4bbbdfb9-7fd7-4e5f-a449-2c4c38f68e9a.\"),\n ),\n original: Query {\n name: Name(\"oxz_clickhouse_4bbbdfb9-7fd7-4e5f-a449-2c4c38f68e9a.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 51,\n 111,\n 120,\n 122,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 95,\n 52,\n 98,\n 98,\n 98,\n 100,\n 102,\n 98,\n 57,\n 45,\n 55,\n 102,\n 100,\n 55,\n 45,\n 52,\n 101,\n 53,\n 102,\n 45,\n 97,\n 52,\n 52,\n 57,\n 45,\n 50,\n 99,\n 52,\n 99,\n 51,\n 56,\n 102,\n 54,\n 56,\n 101,\n 57,\n 97,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_clickhouse_4bbbdfb9-7fd7-4e5f-a449-2c4c38f68e9a.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.417642814Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::e]:57748","req_id":"31598b03-318e-43b3-b419-b235963c7601","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 26651,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_clickhouse_4bbbdfb9-7fd7-4e5f-a449-2c4c38f68e9a.\"),\n ),\n original: Query {\n name: Name(\"oxz_clickhouse_4bbbdfb9-7fd7-4e5f-a449-2c4c38f68e9a.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 51,\n 111,\n 120,\n 122,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 95,\n 52,\n 98,\n 98,\n 98,\n 100,\n 102,\n 98,\n 57,\n 45,\n 55,\n 102,\n 100,\n 55,\n 45,\n 52,\n 101,\n 53,\n 102,\n 45,\n 97,\n 52,\n 52,\n 57,\n 45,\n 50,\n 99,\n 52,\n 99,\n 51,\n 56,\n 102,\n 54,\n 56,\n 101,\n 57,\n 97,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_clickhouse_4bbbdfb9-7fd7-4e5f-a449-2c4c38f68e9a.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.418314804Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::e]:62796","req_id":"4ef33165-7fd6-4b78-97d0-6c0fea9eea25","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 11496,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_6909a0de-b79f-4228-9a8a-f43cdea6df3c.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_6909a0de-b79f-4228-9a8a-f43cdea6df3c.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 54,\n 57,\n 48,\n 57,\n 97,\n 48,\n 100,\n 101,\n 45,\n 98,\n 55,\n 57,\n 102,\n 45,\n 52,\n 50,\n 50,\n 56,\n 45,\n 57,\n 97,\n 56,\n 97,\n 45,\n 102,\n 52,\n 51,\n 99,\n 100,\n 101,\n 97,\n 54,\n 100,\n 102,\n 51,\n 99,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_6909a0de-b79f-4228-9a8a-f43cdea6df3c.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.609980861Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::6]:34096","req_id":"5b1078a4-c92f-42b3-b7f5-4181ab6297db","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 11496,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_6909a0de-b79f-4228-9a8a-f43cdea6df3c.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_6909a0de-b79f-4228-9a8a-f43cdea6df3c.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 54,\n 57,\n 48,\n 57,\n 97,\n 48,\n 100,\n 101,\n 45,\n 98,\n 55,\n 57,\n 102,\n 45,\n 52,\n 50,\n 50,\n 56,\n 45,\n 57,\n 97,\n 56,\n 97,\n 45,\n 102,\n 52,\n 51,\n 99,\n 100,\n 101,\n 97,\n 54,\n 100,\n 102,\n 51,\n 99,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_6909a0de-b79f-4228-9a8a-f43cdea6df3c.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.610674952Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::6]:40007","req_id":"1db52e4b-b2d4-475d-b530-6a3077695ac0","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 40366,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_switch.\"),\n ),\n original: Query {\n name: Name(\"oxz_switch.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 111,\n 120,\n 122,\n 95,\n 115,\n 119,\n 105,\n 116,\n 99,\n 104,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_switch.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.683642481Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::2]:57915","req_id":"afbc80d9-43ca-42a1-bab6-0ed6b3145729","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 40366,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_switch.\"),\n ),\n original: Query {\n name: Name(\"oxz_switch.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 111,\n 120,\n 122,\n 95,\n 115,\n 119,\n 105,\n 116,\n 99,\n 104,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_switch.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.684292129Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::2]:37592","req_id":"3c8b07b3-6cb6-4b3c-8472-38a5873f3543","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57071,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_74e584aa-b71f-4fd7-a4f4-d34ff61f1d67.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_74e584aa-b71f-4fd7-a4f4-d34ff61f1d67.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 55,\n 52,\n 101,\n 53,\n 56,\n 52,\n 97,\n 97,\n 45,\n 98,\n 55,\n 49,\n 102,\n 45,\n 52,\n 102,\n 100,\n 55,\n 45,\n 97,\n 52,\n 102,\n 52,\n 45,\n 100,\n 51,\n 52,\n 102,\n 102,\n 54,\n 49,\n 102,\n 49,\n 100,\n 54,\n 55,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_74e584aa-b71f-4fd7-a4f4-d34ff61f1d67.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.70880771Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::3]:43704","req_id":"b78cc70b-fca8-41f4-82a5-2723e6d4211e","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 57071,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_74e584aa-b71f-4fd7-a4f4-d34ff61f1d67.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_74e584aa-b71f-4fd7-a4f4-d34ff61f1d67.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 55,\n 52,\n 101,\n 53,\n 56,\n 52,\n 97,\n 97,\n 45,\n 98,\n 55,\n 49,\n 102,\n 45,\n 52,\n 102,\n 100,\n 55,\n 45,\n 97,\n 52,\n 102,\n 52,\n 45,\n 100,\n 51,\n 52,\n 102,\n 102,\n 54,\n 49,\n 102,\n 49,\n 100,\n 54,\n 55,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_74e584aa-b71f-4fd7-a4f4-d34ff61f1d67.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.709538235Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::3]:54716","req_id":"37d4d991-1cd3-4e1e-b031-690e82f3f7ce","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 49499,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_18c2e53d-8b84-4a02-82f6-9b9a20f4b01c.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_18c2e53d-8b84-4a02-82f6-9b9a20f4b01c.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 49,\n 56,\n 99,\n 50,\n 101,\n 53,\n 51,\n 100,\n 45,\n 56,\n 98,\n 56,\n 52,\n 45,\n 52,\n 97,\n 48,\n 50,\n 45,\n 56,\n 50,\n 102,\n 54,\n 45,\n 57,\n 98,\n 57,\n 97,\n 50,\n 48,\n 102,\n 52,\n 98,\n 48,\n 49,\n 99,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_18c2e53d-8b84-4a02-82f6-9b9a20f4b01c.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.717640295Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::4]:42835","req_id":"a89b45e7-a392-49b0-bb55-f57bffe37ed5","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 49499,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_18c2e53d-8b84-4a02-82f6-9b9a20f4b01c.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_18c2e53d-8b84-4a02-82f6-9b9a20f4b01c.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 49,\n 56,\n 99,\n 50,\n 101,\n 53,\n 51,\n 100,\n 45,\n 56,\n 98,\n 56,\n 52,\n 45,\n 52,\n 97,\n 48,\n 50,\n 45,\n 56,\n 50,\n 102,\n 54,\n 45,\n 57,\n 98,\n 57,\n 97,\n 50,\n 48,\n 102,\n 52,\n 98,\n 48,\n 49,\n 99,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_18c2e53d-8b84-4a02-82f6-9b9a20f4b01c.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.718499248Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::4]:60895","req_id":"a662ea7e-d91d-4dc1-aa44-19dbfbd10f09","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41626,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_72d11d24-2ab7-44e9-b883-e73006a75118.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_72d11d24-2ab7-44e9-b883-e73006a75118.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 55,\n 50,\n 100,\n 49,\n 49,\n 100,\n 50,\n 52,\n 45,\n 50,\n 97,\n 98,\n 55,\n 45,\n 52,\n 52,\n 101,\n 57,\n 45,\n 98,\n 56,\n 56,\n 51,\n 45,\n 101,\n 55,\n 51,\n 48,\n 48,\n 54,\n 97,\n 55,\n 53,\n 49,\n 49,\n 56,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_72d11d24-2ab7-44e9-b883-e73006a75118.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.749005079Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::7]:56122","req_id":"81196da6-5b8a-4726-8777-b6ae3eb31f35","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 41626,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_72d11d24-2ab7-44e9-b883-e73006a75118.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_72d11d24-2ab7-44e9-b883-e73006a75118.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 55,\n 50,\n 100,\n 49,\n 49,\n 100,\n 50,\n 52,\n 45,\n 50,\n 97,\n 98,\n 55,\n 45,\n 52,\n 52,\n 101,\n 57,\n 45,\n 98,\n 56,\n 56,\n 51,\n 45,\n 101,\n 55,\n 51,\n 48,\n 48,\n 54,\n 97,\n 55,\n 53,\n 49,\n 49,\n 56,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_72d11d24-2ab7-44e9-b883-e73006a75118.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.74971273Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::7]:40606","req_id":"2f142545-6a99-45c3-a9f3-5d2ca3768c9f","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28207,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_8b3cf440-ec62-4b2e-ba9c-2f12a92d3ddf.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_8b3cf440-ec62-4b2e-ba9c-2f12a92d3ddf.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 56,\n 98,\n 51,\n 99,\n 102,\n 52,\n 52,\n 48,\n 45,\n 101,\n 99,\n 54,\n 50,\n 45,\n 52,\n 98,\n 50,\n 101,\n 45,\n 98,\n 97,\n 57,\n 99,\n 45,\n 50,\n 102,\n 49,\n 50,\n 97,\n 57,\n 50,\n 100,\n 51,\n 100,\n 100,\n 102,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_8b3cf440-ec62-4b2e-ba9c-2f12a92d3ddf.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.774992464Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::5]:63818","req_id":"95a30630-e3f1-4e26-909b-91e7ce5181bd","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 28207,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 0,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"oxz_cockroachdb_8b3cf440-ec62-4b2e-ba9c-2f12a92d3ddf.\"),\n ),\n original: Query {\n name: Name(\"oxz_cockroachdb_8b3cf440-ec62-4b2e-ba9c-2f12a92d3ddf.\"),\n query_type: A,\n query_class: IN,\n },\n },\n ],\n original: [\n 52,\n 111,\n 120,\n 122,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 100,\n 98,\n 95,\n 56,\n 98,\n 51,\n 99,\n 102,\n 52,\n 52,\n 48,\n 45,\n 101,\n 99,\n 54,\n 50,\n 45,\n 52,\n 98,\n 50,\n 101,\n 45,\n 98,\n 97,\n 57,\n 99,\n 45,\n 50,\n 102,\n 49,\n 50,\n 97,\n 57,\n 50,\n 100,\n 51,\n 100,\n 100,\n 102,\n 0,\n 0,\n 1,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: None,\n} SERVFAIL: server is not authoritative for name: \"oxz_cockroachdb_8b3cf440-ec62-4b2e-ba9c-2f12a92d3ddf.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:00.775647123Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::5]:61596","req_id":"a5d95350-285d-4d59-ab9b-3e2aef6542ca","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 37381,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:02.941685674Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::d]:56185","req_id":"8874320e-205f-481d-9ee4-0a3f3ee8e744","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 17534,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:12.943816882Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::d]:55701","req_id":"ff3cd6d8-c6cd-4692-974e-c891c9a3ab81","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:21.396791741Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:51196"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:21.398271253Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"new_generation":1,"req_id":"f2d0dc7f-c70c-4f2e-a664-ae8e8b5cdc8b","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:21.398299534Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"new_generation":1,"req_id":"f2d0dc7f-c70c-4f2e-a664-ae8e8b5cdc8b","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:21.398310974Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"uri":"/config","method":"PUT","req_id":"f2d0dc7f-c70c-4f2e-a664-ae8e8b5cdc8b","remote_addr":"[fd00:1122:3344:101::a]:51196","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":269,"response_code":204} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:21.413153273Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:52800"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:21.414168588Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"new_generation":1,"req_id":"82436809-a512-4093-b9e7-1c59d70d807b","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:21.414197009Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"new_generation":1,"req_id":"82436809-a512-4093-b9e7-1c59d70d807b","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:21.414208739Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"uri":"/config","method":"PUT","req_id":"82436809-a512-4093-b9e7-1c59d70d807b","remote_addr":"[fd00:1122:3344:101::c]:52800","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":987,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 65381,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:22.176734556Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::c]:33619","req_id":"973be3eb-7f72-43e8-9035-f7d4aa085af5","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 1317,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:22.17705567Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::a]:36335","req_id":"0606105d-c7d7-498b-9bc0-8e1612f009af","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:22.310433995Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:32852"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:22.310650018Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"uri":"/config","method":"GET","req_id":"4d3c023a-50ac-4e89-9dc2-08f5df7ca891","remote_addr":"[fd00:1122:3344:101::a]:32852","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":178,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:22.360606947Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:60409"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:22.360815021Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"uri":"/config","method":"GET","req_id":"6fd64928-8a4f-4a96-8a64-31103e6e0a21","remote_addr":"[fd00:1122:3344:101::c]:60409","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":175,"response_code":200} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:22.448275215Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:64784"} {"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:22.449772387Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"new_generation":1,"req_id":"6b2e99a2-3811-47ec-812e-df8a34efee10","component":"store"} {"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:22.449877279Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"new_generation":1,"req_id":"6b2e99a2-3811-47ec-812e-df8a34efee10","component":"store"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:22.44990348Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"uri":"/config","method":"PUT","req_id":"6b2e99a2-3811-47ec-812e-df8a34efee10","remote_addr":"[fd00:1122:3344:101::b]:64784","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":261,"response_code":204} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 50392,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:22.945622277Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::d]:57325","req_id":"7ac791e5-6599-4ba9-af16-bde390145618","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 60605,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:23.191471686Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::b]:16831","req_id":"cc6e1093-d909-4e78-93fb-a816ca06a9aa","component":"dns"} {"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:23.309466543Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:36700"} {"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-12T02:00:23.309697866Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"uri":"/config","method":"GET","req_id":"1cac9e88-b7aa-4138-a3dc-51a8e4592ff4","remote_addr":"[fd00:1122:3344:101::b]:36700","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":199,"response_code":200} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 511,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:32.94784432Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::d]:60447","req_id":"e65f48db-ef6d-4587-b23c-8c716d0838ac","component":"dns"} {"msg":"failed to handle incoming DNS message: MessageRequest {\n header: Header {\n id: 35046,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n ),\n original: Query {\n name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 26,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 99,\n 108,\n 117,\n 115,\n 116,\n 101,\n 114,\n 45,\n 110,\n 97,\n 116,\n 105,\n 118,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-12T02:00:42.949544746Z","hostname":"oxz_internal_dns_3eb9c569-9d28-4b74-9355-f93c728190ed","pid":5419,"peer_addr":"[fd00:1122:3344:101::d]:64631","req_id":"7c81da1b-ffe1-42d8-bcfe-4cd079b2729c","component":"dns"}