{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 34274,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:03.915155926Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:56985","req_id":"d9651a21-15c3-482f-93e6-8e9b8e385122","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 29471,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:13.916750018Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:62631","req_id":"f5525855-7f2e-4870-a9de-2a110cef511c","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 54877,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:23.918879232Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:58793","req_id":"8481962b-838f-40af-b8e5-a2c20235f1bc","component":"dns"}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.086643648Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:57172"}
{"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.088587381Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"2dd65295-c980-4a50-aefe-8a0801ac393e","component":"store"}
{"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.088616382Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"2dd65295-c980-4a50-aefe-8a0801ac393e","component":"store"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.088626672Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"PUT","req_id":"2dd65295-c980-4a50-aefe-8a0801ac393e","remote_addr":"[fd00:1122:3344:101::c]:57172","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":168,"response_code":204}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.092585918Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:57831"}
{"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.095104678Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"f64f0ca3-71c9-48cb-a998-055c43a4eabb","component":"store"}
{"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.095124428Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"f64f0ca3-71c9-48cb-a998-055c43a4eabb","component":"store"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.095132328Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"PUT","req_id":"f64f0ca3-71c9-48cb-a998-055c43a4eabb","remote_addr":"[fd00:1122:3344:101::a]:57831","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":164,"response_code":204}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.11608347Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:46194"}
{"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.118575706Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"acc45894-19ed-4878-94a3-7e670b642e18","component":"store"}
{"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.118613416Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"acc45894-19ed-4878-94a3-7e670b642e18","component":"store"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:33.118629367Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"PUT","req_id":"acc45894-19ed-4878-94a3-7e670b642e18","remote_addr":"[fd00:1122:3344:101::b]:46194","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":235,"response_code":204}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 45326,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:33.920310901Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:53955","req_id":"3d7e7d1e-e5e9-4abb-83ca-8fa9648a1771","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 28803,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            24,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            97,\n            100,\n            109,\n            105,\n            110,\n            45,\n            107,\n            101,\n            101,\n            112,\n            101,\n            114,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:34.643157722Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::c]:37096","req_id":"6af314b2-3d03-4cb9-96f3-82c6625b04af","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 33592,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            24,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            97,\n            100,\n            109,\n            105,\n            110,\n            45,\n            107,\n            101,\n            101,\n            112,\n            101,\n            114,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:34.649017143Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::b]:30540","req_id":"70852d60-ffa4-4da3-9563-205dc1be853b","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 54938,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            24,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            97,\n            100,\n            109,\n            105,\n            110,\n            45,\n            107,\n            101,\n            101,\n            112,\n            101,\n            114,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:34.699968449Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::a]:44713","req_id":"a031d869-1638-4cfb-86a7-a19c088ed0d8","component":"dns"}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:34.75429216Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:37470"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:34.754585737Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"GET","req_id":"a96b7fb1-3c5c-4c8e-9956-a8c970a4de84","remote_addr":"[fd00:1122:3344:101::b]:37470","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":231,"response_code":200}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:34.83924662Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:53271"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:34.839589778Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"GET","req_id":"501e1047-1d09-4ca5-ab38-767386282434","remote_addr":"[fd00:1122:3344:101::c]:53271","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":299,"response_code":200}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:34.897291816Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:57692"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:45:34.897533811Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"GET","req_id":"11d213d8-b9db-4234-93cf-55b89def0823","remote_addr":"[fd00:1122:3344:101::a]:57692","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":202,"response_code":200}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 18138,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:43.922078457Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:57991","req_id":"2d9ccd05-2588-4446-92e1-75e128a7dfa8","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 34754,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:53.923493896Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:49522","req_id":"7dff582b-b33b-4755-9855-ad2daabb62b3","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 25254,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 0,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"0.pool.ntp.org.\"),\n                ),\n                original: Query {\n                    name: Name(\"0.pool.ntp.org.\"),\n                    query_type: AAAA,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            1,\n            48,\n            4,\n            112,\n            111,\n            111,\n            108,\n            3,\n            110,\n            116,\n            112,\n            3,\n            111,\n            114,\n            103,\n            0,\n            0,\n            28,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:56.172356426Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::1b]:56381","req_id":"a07cc694-9faf-4272-8e92-a6f8f15f2c74","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 17997,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 0,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"0.pool.ntp.org.\"),\n                ),\n                original: Query {\n                    name: Name(\"0.pool.ntp.org.\"),\n                    query_type: AAAA,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            1,\n            48,\n            4,\n            112,\n            111,\n            111,\n            108,\n            3,\n            110,\n            116,\n            112,\n            3,\n            111,\n            114,\n            103,\n            0,\n            0,\n            28,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:56.176307965Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::1b]:46227","req_id":"92e39156-6d7a-425f-995d-c59c72896cac","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 38640,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 0,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"0.pool.ntp.org.\"),\n                ),\n                original: Query {\n                    name: Name(\"0.pool.ntp.org.\"),\n                    query_type: A,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            1,\n            48,\n            4,\n            112,\n            111,\n            111,\n            108,\n            3,\n            110,\n            116,\n            112,\n            3,\n            111,\n            114,\n            103,\n            0,\n            0,\n            1,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: None,\n} SERVFAIL: server is not authoritative for name: \"0.pool.ntp.org.\"","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:45:56.180441238Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::1b]:64347","req_id":"6851c24c-e898-42d8-bc9c-5d60910a803f","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 20902,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:03.925220481Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:63748","req_id":"9683813d-cd88-4c45-a483-255d98261ef8","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 59867,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:13.927246212Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:51212","req_id":"3864f0e6-a8f9-457e-88a5-74422dce5b35","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 13065,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:23.928355352Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:61703","req_id":"a9da74c3-fc7e-441a-9b38-e5a803497e13","component":"dns"}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.085698543Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:32849"}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.087756719Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:35161"}
{"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.088286142Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"d2508136-5486-468c-958e-bd396c524f47","component":"store"}
{"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.088311312Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"d2508136-5486-468c-958e-bd396c524f47","component":"store"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.088319682Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"PUT","req_id":"d2508136-5486-468c-958e-bd396c524f47","remote_addr":"[fd00:1122:3344:101::c]:32849","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":170,"response_code":204}
{"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.090185664Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"e948d9e8-b0b0-4823-8b7c-25d42f70ab6e","component":"store"}
{"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.090209835Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"e948d9e8-b0b0-4823-8b7c-25d42f70ab6e","component":"store"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.090219255Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"PUT","req_id":"e948d9e8-b0b0-4823-8b7c-25d42f70ab6e","remote_addr":"[fd00:1122:3344:101::a]:35161","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":156,"response_code":204}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.115284358Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:55443"}
{"msg":"attempting generation update","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.120188929Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"1505c276-564b-4b1d-beb9-a64435bdf9f7","component":"store"}
{"msg":"updated generation","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.12023485Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"new_generation":1,"req_id":"1505c276-564b-4b1d-beb9-a64435bdf9f7","component":"store"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:33.12024899Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"PUT","req_id":"1505c276-564b-4b1d-beb9-a64435bdf9f7","remote_addr":"[fd00:1122:3344:101::b]:55443","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":208,"response_code":204}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 50213,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:33.930131349Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:54836","req_id":"2eac38f0-5ba2-40a8-95ae-350141853151","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 40172,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            24,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            97,\n            100,\n            109,\n            105,\n            110,\n            45,\n            107,\n            101,\n            101,\n            112,\n            101,\n            114,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:37.200560886Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::a]:51836","req_id":"da30c7d2-f3ca-47e3-a08f-a0620ca2c525","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 33749,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            24,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            97,\n            100,\n            109,\n            105,\n            110,\n            45,\n            107,\n            101,\n            101,\n            112,\n            101,\n            114,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:37.206580441Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::c]:20161","req_id":"907bc6f8-aa72-421f-a3ca-7391fba6f8d9","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 4957,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-admin-keeper._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            24,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            97,\n            100,\n            109,\n            105,\n            110,\n            45,\n            107,\n            101,\n            101,\n            112,\n            101,\n            114,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:37.206794526Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::b]:28476","req_id":"81af4c5f-de47-4785-8f80-79779b2795d6","component":"dns"}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:37.409535583Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::a]:35031"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:37.409782239Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"GET","req_id":"dae6ff65-5795-4738-b183-9845528349e7","remote_addr":"[fd00:1122:3344:101::a]:35031","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":209,"response_code":200}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:37.453703476Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::b]:41050"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:37.453975653Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"GET","req_id":"4de3d3b7-891e-4ad9-86ac-7515e36958e2","remote_addr":"[fd00:1122:3344:101::b]:41050","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":223,"response_code":200}
{"msg":"accepted connection","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:37.488906228Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","remote_addr":"[fd00:1122:3344:101::c]:56433"}
{"msg":"request completed","v":0,"name":"dns-server","level":30,"time":"2026-05-02T04:46:37.489156984Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"uri":"/config","method":"GET","req_id":"7011371a-4610-4b77-a931-9d0be61378b4","remote_addr":"[fd00:1122:3344:101::c]:56433","local_addr":"[fd00:1122:3344:3::1]:5353","component":"http","latency_us":216,"response_code":200}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 52824,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:43.932213651Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:55462","req_id":"bb5c8db4-b04c-4f66-998e-23d5f08218f6","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 34998,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:46:53.934002967Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:55721","req_id":"1911ff10-c8a2-41a3-a264-c4495e5ca179","component":"dns"}
{"msg":"failed to handle incoming DNS message: MessageRequest {\n    header: Header {\n        id: 32626,\n        message_type: Query,\n        op_code: Query,\n        authoritative: false,\n        truncation: false,\n        recursion_desired: true,\n        recursion_available: false,\n        authentic_data: false,\n        checking_disabled: false,\n        response_code: NoError,\n        query_count: 1,\n        answer_count: 0,\n        name_server_count: 0,\n        additional_count: 1,\n    },\n    queries: Queries {\n        queries: [\n            LowerQuery {\n                name: LowerName(\n                    Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                ),\n                original: Query {\n                    name: Name(\"_clickhouse-cluster-native._tcp.control-plane.oxide.internal.\"),\n                    query_type: SRV,\n                    query_class: IN,\n                },\n            },\n        ],\n        original: [\n            26,\n            95,\n            99,\n            108,\n            105,\n            99,\n            107,\n            104,\n            111,\n            117,\n            115,\n            101,\n            45,\n            99,\n            108,\n            117,\n            115,\n            116,\n            101,\n            114,\n            45,\n            110,\n            97,\n            116,\n            105,\n            118,\n            101,\n            4,\n            95,\n            116,\n            99,\n            112,\n            13,\n            99,\n            111,\n            110,\n            116,\n            114,\n            111,\n            108,\n            45,\n            112,\n            108,\n            97,\n            110,\n            101,\n            5,\n            111,\n            120,\n            105,\n            100,\n            101,\n            8,\n            105,\n            110,\n            116,\n            101,\n            114,\n            110,\n            97,\n            108,\n            0,\n            0,\n            33,\n            0,\n            1,\n        ],\n    },\n    answers: [],\n    name_servers: [],\n    additionals: [],\n    sig0: [],\n    edns: Some(\n        Edns {\n            rcode_high: 0,\n            version: 0,\n            flags: EdnsFlags {\n                dnssec_ok: false,\n                z: 0,\n            },\n            max_payload: 1232,\n            options: OPT {\n                options: [],\n            },\n        },\n    ),\n} NXDOMAIN: _clickhouse-cluster-native._tcp.control-plane.oxide.internal","v":0,"name":"dns-server","level":50,"time":"2026-05-02T04:47:03.935498935Z","hostname":"oxz_internal_dns_5080cb9d-672e-4d5a-bcf8-65934ec72938","pid":5537,"peer_addr":"[fd00:1122:3344:101::d]:62347","req_id":"2a74c520-a374-4955-8265-34dd6d06f0f5","component":"dns"}