Max level shown:
1 [ Jun 22 01:58:50 Enabled. ]
2 [ Jun 22 01:58:51 Rereading configuration. ]
3 [ Jun 22 01:58:51 Rereading configuration. ]
4 [ Jun 22 01:58:53 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 1006b3bf-a9da-42f1-a646-5acd47e2044d &"). ]
5 [ Jun 22 01:58:53 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-06-22T01:58:53.631ZDEBGoximeter: registered DTrace probes
82024-06-22T01:58:53.640ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:194
92024-06-22T01:58:53.644ZINFOoximeter (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
102024-06-22T01:58:53.654ZDEBGoximeter: creating ClickHouse client
112024-06-22T01:58:53.654ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
122024-06-22T01:59:04.036ZWARNoximeter (clickhouse-client): failed to read version collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:683 id = cb64bfed-10ae-41be-9a91-67200bf66b07
132024-06-22T01:59:04.038ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 188.393087ms
142024-06-22T01:59:04.227ZDEBGoximeter: creating ClickHouse client
152024-06-22T01:59:04.227ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
162024-06-22T01:59:04.256ZWARNoximeter (clickhouse-client): failed to read version collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:683 id = 0d69c6c6-b3f2-42b2-b8ce-b625887bec51
172024-06-22T01:59:04.256ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 580.606725ms
182024-06-22T01:59:04.839ZDEBGoximeter: creating ClickHouse client
192024-06-22T01:59:04.839ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
202024-06-22T01:59:04.869ZWARNoximeter (clickhouse-client): failed to read version collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:683 id = 6e54232c-6ed4-4bb5-831d-711ebe021707
212024-06-22T01:59:04.869ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 993.852573ms
222024-06-22T01:59:05.865ZDEBGoximeter: creating ClickHouse client
232024-06-22T01:59:05.865ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
242024-06-22T01:59:06.456ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:679 id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
252024-06-22T01:59:06.456ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d
262024-06-22T01:59:06.476ZINFOoximeter (clickhouse-client): reading db version collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:617 id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
272024-06-22T01:59:06.478ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:679 id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
282024-06-22T01:59:06.478ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:621 id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd version = 0
292024-06-22T01:59:06.478ZINFOoximeter (clickhouse-client): wiping and re-initializing oximeter schema collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:626 id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
302024-06-22T01:59:06.478ZDEBGoximeter (clickhouse-client): wiping ClickHouse database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
312024-06-22T01:59:06.479ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
322024-06-22T01:59:06.685ZINFOoximeter (clickhouse-client): inserting current version collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:649 id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd version = 4
332024-06-22T01:59:06.717ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info
342024-06-22T01:59:06.717ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers
352024-06-22T01:59:06.717ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = POST path = /producers
362024-06-22T01:59:06.717ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id}
372024-06-22T01:59:06.717ZINFOoximeter (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::d]:12223
382024-06-22T01:59:06.717ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
392024-06-22T01:59:06.717ZDEBGoximeter: contacting nexus
402024-06-22T01:59:06.717ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
412024-06-22T01:59:06.752ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
422024-06-22T01:59:06.771ZDEBGoximeter: client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, status: 204, headers: {"x-request-id": "41d6c6dd-12b3-4b2d-9453-590552908457", "date": "Sat, 22 Jun 2024 01:59:06 GMT"} })
432024-06-22T01:59:06.774ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:302 id = 1006b3bf-a9da-42f1-a646-5acd47e2044d
442024-06-22T01:59:06.775ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:757
452024-06-22T01:59:06.775ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
462024-06-22T01:59:06.812ZDEBGoximeter (oximeter-agent): client request body = None collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/1006b3bf-a9da-42f1-a646-5acd47e2044d/producers?sort_by=id_ascending
472024-06-22T01:59:06.815ZDEBGoximeter (oximeter-agent): client response collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/collectors/1006b3bf-a9da-42f1-a646-5acd47e2044d/producers", query: Some("sort_by=id_ascending"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd934338-50cd-46de-b55b-1ee4daef471e", "content-length": "29", "date": "Sat, 22 Jun 2024 01:59:06 GMT"} })
482024-06-22T01:59:06.817ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:807 n_current_tasks = 0 n_pruned_tasks = 0
492024-06-22T01:59:08.572ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:54905
502024-06-22T01:59:08.572ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
512024-06-22T01:59:08.572ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 180 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:54905 req_id = b61bf279-f3f5-450d-9fcd-24321817db6f response_code = 204 uri = /producers
522024-06-22T01:59:08.605ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
532024-06-22T01:59:18.605ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
542024-06-22T01:59:18.612ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
552024-06-22T01:59:21.696ZDEBGoximeter (results-sink): inserting 27 samples into database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d
562024-06-22T01:59:21.696ZDEBGoximeter (clickhouse-client): unrolling 27 total samples collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
572024-06-22T01:59:21.727ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
582024-06-22T01:59:21.731ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd schema = {"timeseries_name":"http_service:request_latency_histogram","fields.name":["id","method","name","route","status_code"],"fields.type":["Uuid","String","String","String","I64"],"fields.source":["Target","Metric","Target","Metric","Metric"],"datum_type":"HistogramF64","created":"2024-06-22 01:59:21.727439843"} timeseries_name = http_service:request_latency_histogram
592024-06-22T01:59:21.736ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
602024-06-22T01:59:21.740ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd schema = {"timeseries_name":"collection_target:cpus_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-06-22 01:59:21.736787315"} timeseries_name = collection_target:cpus_provisioned
612024-06-22T01:59:21.742ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
622024-06-22T01:59:21.744ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd schema = {"timeseries_name":"collection_target:ram_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-06-22 01:59:21.742586873"} timeseries_name = collection_target:ram_provisioned
632024-06-22T01:59:21.744ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
642024-06-22T01:59:21.746ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd schema = {"timeseries_name":"collection_target:virtual_disk_space_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-06-22 01:59:21.744448631"} timeseries_name = collection_target:virtual_disk_space_provisioned
652024-06-22T01:59:21.746ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
662024-06-22T01:59:21.752ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 15 table_name = oximeter.fields_i64
672024-06-22T01:59:21.754ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 45 table_name = oximeter.fields_string
682024-06-22T01:59:21.757ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 22 table_name = oximeter.fields_uuid
692024-06-22T01:59:21.762ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 15 table_name = oximeter.measurements_histogramf64
702024-06-22T01:59:21.764ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 12 table_name = oximeter.measurements_i64
712024-06-22T01:59:28.604ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
722024-06-22T01:59:28.606ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
732024-06-22T01:59:31.695ZDEBGoximeter (results-sink): inserting 15 samples into database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d
742024-06-22T01:59:31.695ZDEBGoximeter (clickhouse-client): unrolling 15 total samples collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
752024-06-22T01:59:31.699ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 15 table_name = oximeter.fields_i64
762024-06-22T01:59:31.701ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 45 table_name = oximeter.fields_string
772024-06-22T01:59:31.703ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 15 table_name = oximeter.fields_uuid
782024-06-22T01:59:31.706ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 15 table_name = oximeter.measurements_histogramf64
792024-06-22T01:59:38.603ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
802024-06-22T01:59:38.605ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
812024-06-22T01:59:41.696ZDEBGoximeter (results-sink): inserting 16 samples into database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d
822024-06-22T01:59:41.696ZDEBGoximeter (clickhouse-client): unrolling 16 total samples collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
832024-06-22T01:59:41.700ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 16 table_name = oximeter.fields_i64
842024-06-22T01:59:41.702ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 48 table_name = oximeter.fields_string
852024-06-22T01:59:41.704ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 16 table_name = oximeter.fields_uuid
862024-06-22T01:59:41.706ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 16 table_name = oximeter.measurements_histogramf64
872024-06-22T01:59:48.603ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
882024-06-22T01:59:48.605ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
892024-06-22T01:59:51.696ZDEBGoximeter (results-sink): inserting 16 samples into database collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d
902024-06-22T01:59:51.696ZDEBGoximeter (clickhouse-client): unrolling 16 total samples collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd
912024-06-22T01:59:51.700ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 16 table_name = oximeter.fields_i64
922024-06-22T01:59:51.702ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 48 table_name = oximeter.fields_string
932024-06-22T01:59:51.704ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 16 table_name = oximeter.fields_uuid
942024-06-22T01:59:51.706ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d id = fd0a5af3-4995-47f9-a331-e980e7cdb5bd n_rows = 16 table_name = oximeter.measurements_histogramf64
952024-06-22T01:59:58.604ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
962024-06-22T01:59:58.606ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::c]:34190 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 59cebf87-1ddd-4cf3-8dfe-af47c91c765f
972024-06-22T01:59:59.626ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:53142
982024-06-22T01:59:59.626ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d producer_id = a15209ab-0698-4931-8f59-81b5ffe79145
992024-06-22T01:59:59.626ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:53142 req_id = c477d86f-e586-4047-b820-62e8b31f4d99 response_code = 204 uri = /producers
1002024-06-22T01:59:59.657ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::1]:8001 collector_id = 1006b3bf-a9da-42f1-a646-5acd47e2044d collector_ip = fd00:1122:3344:101::d interval = 1s producer_id = a15209ab-0698-4931-8f59-81b5ffe79145