Max level shown:
1 [ Feb 23 10:12:41 Enabled. ]
2 [ Feb 23 10:12:41 Rereading configuration. ]
3 [ Feb 23 10:12:45 Rereading configuration. ]
4 [ Feb 23 10:12:48 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 0782e7a3-76a2-4968-83fc-5980b90c4541 &"). ]
5 [ Feb 23 10:12:48 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-02-23T10:12:48.971ZDEBGoximeter: registered DTrace probes
82024-02-23T10:12:48.976ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:192
92024-02-23T10:12:48.978ZINFOoximeter (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
102024-02-23T10:12:48.980ZDEBGoximeter: creating ClickHouse client
112024-02-23T10:12:48.980ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
122024-02-23T10:12:49.110ZWARNoximeter (clickhouse-client): failed to read version collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client.rs:868 id = d8bb3915-ccdc-45be-a57c-4deb488a26ab
132024-02-23T10:12:49.111ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:213 retry_after = 323.409724ms
142024-02-23T10:12:49.435ZDEBGoximeter: creating ClickHouse client
152024-02-23T10:12:49.435ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
162024-02-23T10:12:49.478ZWARNoximeter (clickhouse-client): failed to read version collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client.rs:868 id = 0ac268c8-7e06-402b-807c-f845eb7ece3f
172024-02-23T10:12:49.478ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:213 retry_after = 494.548358ms
182024-02-23T10:12:49.973ZDEBGoximeter: creating ClickHouse client
192024-02-23T10:12:49.973ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
202024-02-23T10:12:50.004ZWARNoximeter (clickhouse-client): failed to read version collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client.rs:868 id = c5463bfd-2cab-4129-a0d2-89f3e08ddce6
212024-02-23T10:12:50.004ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:213 retry_after = 1.406011897s
222024-02-23T10:12:51.411ZDEBGoximeter: creating ClickHouse client
232024-02-23T10:12:51.411ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
242024-02-23T10:12:51.472ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 file = oximeter/db/src/client.rs:864 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
252024-02-23T10:12:51.472ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
262024-02-23T10:12:51.480ZINFOoximeter (clickhouse-client): reading db version collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 file = oximeter/db/src/client.rs:802 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
272024-02-23T10:12:51.481ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 file = oximeter/db/src/client.rs:864 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
282024-02-23T10:12:51.481ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 file = oximeter/db/src/client.rs:806 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 version = 0
292024-02-23T10:12:51.481ZINFOoximeter (clickhouse-client): wiping and re-initializing oximeter schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 file = oximeter/db/src/client.rs:811 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
302024-02-23T10:12:51.481ZDEBGoximeter (clickhouse-client): wiping ClickHouse database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
312024-02-23T10:12:51.481ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
322024-02-23T10:12:51.708ZINFOoximeter (clickhouse-client): inserting current version collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 file = oximeter/db/src/client.rs:834 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 version = 4
332024-02-23T10:12:51.719ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info
342024-02-23T10:12:51.719ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers
352024-02-23T10:12:51.719ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = POST path = /producers
362024-02-23T10:12:51.719ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id}
372024-02-23T10:12:51.719ZINFOoximeter (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:195 local_addr = [fd00:1122:3344:101::d]:12223
382024-02-23T10:12:51.722ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
392024-02-23T10:12:51.753ZDEBGoximeter: contacting nexus
402024-02-23T10:12:51.753ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
412024-02-23T10:13:16.910ZWARNoximeter: failed to contact nexus, will retry in 210.974582ms error = "error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:271
422024-02-23T10:13:17.122ZDEBGoximeter: contacting nexus
432024-02-23T10:13:17.122ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
442024-02-23T10:13:17.122ZWARNoximeter: failed to contact nexus, will retry in 563.053636ms error = "error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:271
452024-02-23T10:13:17.687ZDEBGoximeter: contacting nexus
462024-02-23T10:13:17.687ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
472024-02-23T10:13:17.688ZWARNoximeter: failed to contact nexus, will retry in 618.336498ms error = "error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:271
482024-02-23T10:13:18.307ZDEBGoximeter: contacting nexus
492024-02-23T10:13:18.307ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
502024-02-23T10:13:18.308ZWARNoximeter: failed to contact nexus, will retry in 1.268073256s error = "error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:271
512024-02-23T10:13:19.577ZDEBGoximeter: contacting nexus
522024-02-23T10:13:19.577ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
532024-02-23T10:13:19.578ZWARNoximeter: failed to contact nexus, will retry in 2.504634612s error = "error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:271
542024-02-23T10:13:22.083ZDEBGoximeter: contacting nexus
552024-02-23T10:13:22.083ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
562024-02-23T10:13:22.123ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:285 id = 0782e7a3-76a2-4968-83fc-5980b90c4541
572024-02-23T10:13:26.351ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:48665
582024-02-23T10:13:26.354ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:12345 collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
592024-02-23T10:13:26.354ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:849 latency_us = 2473 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:48665 req_id = 578836d0-102f-485b-aa21-fd13b0b09166 response_code = 204 uri = /producers
602024-02-23T10:13:26.387ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 interval = 30s producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
612024-02-23T10:13:32.594ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:40156
622024-02-23T10:13:32.594ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:12221 collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
632024-02-23T10:13:32.594ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:849 latency_us = 178 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:40156 req_id = 84d17d4c-5fe0-46c2-a8f3-1af26bacbce5 response_code = 204 uri = /producers
642024-02-23T10:13:32.627ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 interval = 10s producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
652024-02-23T10:13:42.627ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
662024-02-23T10:13:42.633ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
672024-02-23T10:13:46.718ZDEBGoximeter (results-sink): inserting 46 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
682024-02-23T10:13:46.718ZDEBGoximeter (clickhouse-client): unrolling 46 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
692024-02-23T10:13:46.726ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
702024-02-23T10:13:46.731ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"http_service:request_latency_histogram","fields.name":["id","method","name","route","status_code"],"fields.type":["Uuid","String","String","String","I64"],"fields.source":["Target","Metric","Target","Metric","Metric"],"datum_type":"HistogramF64","created":"2024-02-23 10:13:46.726256353"} timeseries_name = http_service:request_latency_histogram
712024-02-23T10:13:46.740ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
722024-02-23T10:13:46.747ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"collection_target:cpus_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-02-23 10:13:46.740653428"} timeseries_name = collection_target:cpus_provisioned
732024-02-23T10:13:46.747ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
742024-02-23T10:13:46.749ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"collection_target:ram_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-02-23 10:13:46.747615231"} timeseries_name = collection_target:ram_provisioned
752024-02-23T10:13:46.749ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
762024-02-23T10:13:46.751ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"collection_target:virtual_disk_space_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-02-23 10:13:46.749599881"} timeseries_name = collection_target:virtual_disk_space_provisioned
772024-02-23T10:13:46.752ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
782024-02-23T10:13:46.760ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 34 table_name = oximeter.fields_i64
792024-02-23T10:13:46.762ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 102 table_name = oximeter.fields_string
802024-02-23T10:13:46.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 41 table_name = oximeter.fields_uuid
812024-02-23T10:13:46.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 34 table_name = oximeter.measurements_histogramf64
822024-02-23T10:13:46.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 12 table_name = oximeter.measurements_i64
832024-02-23T10:13:52.627ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
842024-02-23T10:13:52.631ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
852024-02-23T10:13:56.387ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
862024-02-23T10:13:56.400ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 1 producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
872024-02-23T10:13:56.718ZDEBGoximeter (results-sink): inserting 479 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
882024-02-23T10:13:56.718ZDEBGoximeter (clickhouse-client): unrolling 479 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
892024-02-23T10:13:56.721ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
902024-02-23T10:13:56.727ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"physical_data_link:errors_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-02-23 10:13:56.721248879"} timeseries_name = physical_data_link:errors_received
912024-02-23T10:13:56.728ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
922024-02-23T10:13:56.730ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"physical_data_link:errors_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-02-23 10:13:56.728027018"} timeseries_name = physical_data_link:errors_sent
932024-02-23T10:13:56.730ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
942024-02-23T10:13:56.732ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"physical_data_link:bytes_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-02-23 10:13:56.730474968"} timeseries_name = physical_data_link:bytes_received
952024-02-23T10:13:56.732ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
962024-02-23T10:13:56.735ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"physical_data_link:packets_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-02-23 10:13:56.732888268"} timeseries_name = physical_data_link:packets_received
972024-02-23T10:13:56.735ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
982024-02-23T10:13:56.737ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"physical_data_link:bytes_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-02-23 10:13:56.735395529"} timeseries_name = physical_data_link:bytes_sent
992024-02-23T10:13:56.737ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1002024-02-23T10:13:56.740ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"physical_data_link:packets_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-02-23 10:13:56.737883460"} timeseries_name = physical_data_link:packets_sent
1012024-02-23T10:13:56.756ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1022024-02-23T10:13:56.759ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_i64
1032024-02-23T10:13:56.760ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 141 table_name = oximeter.fields_string
1042024-02-23T10:13:56.762ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 59 table_name = oximeter.fields_uuid
1052024-02-23T10:13:56.764ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 444 table_name = oximeter.measurements_cumulativeu64
1062024-02-23T10:13:56.766ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.measurements_histogramf64
1072024-02-23T10:14:02.627ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1082024-02-23T10:14:02.630ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1092024-02-23T10:14:06.718ZDEBGoximeter (results-sink): inserting 35 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
1102024-02-23T10:14:06.718ZDEBGoximeter (clickhouse-client): unrolling 35 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1112024-02-23T10:14:06.722ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_i64
1122024-02-23T10:14:06.724ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 105 table_name = oximeter.fields_string
1132024-02-23T10:14:06.725ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_uuid
1142024-02-23T10:14:06.727ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.measurements_histogramf64
1152024-02-23T10:14:12.627ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1162024-02-23T10:14:12.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1172024-02-23T10:14:16.718ZDEBGoximeter (results-sink): inserting 35 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
1182024-02-23T10:14:16.719ZDEBGoximeter (clickhouse-client): unrolling 35 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1192024-02-23T10:14:16.723ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_i64
1202024-02-23T10:14:16.724ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 105 table_name = oximeter.fields_string
1212024-02-23T10:14:16.725ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_uuid
1222024-02-23T10:14:16.727ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.measurements_histogramf64
1232024-02-23T10:14:20.604ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::a]:46283
1242024-02-23T10:14:20.604ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:12221 collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = c2ae76c2-4598-48c6-9e61-c620a8f27348
1252024-02-23T10:14:20.605ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:849 latency_us = 104 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::a]:46283 req_id = 0aa5faa5-76c1-4ec4-b8cf-5713f4d15c85 response_code = 204 uri = /producers
1262024-02-23T10:14:20.636ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 interval = 10s producer_id = c2ae76c2-4598-48c6-9e61-c620a8f27348
1272024-02-23T10:14:20.708ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:44056
1282024-02-23T10:14:20.708ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:12221 collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = e9b22e1e-817f-48f9-983c-31451b7eeff5
1292024-02-23T10:14:20.708ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/711a749/dropshot/src/server.rs:849 latency_us = 718 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:44056 req_id = ea310ad7-9b8c-4ce1-8b2a-40270911a231 response_code = 204 uri = /producers
1302024-02-23T10:14:20.741ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 interval = 10s producer_id = e9b22e1e-817f-48f9-983c-31451b7eeff5
1312024-02-23T10:14:22.627ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1322024-02-23T10:14:22.630ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1332024-02-23T10:14:26.388ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
1342024-02-23T10:14:26.389ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 1 producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
1352024-02-23T10:14:26.389ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
1362024-02-23T10:14:26.718ZDEBGoximeter (results-sink): inserting 72 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
1372024-02-23T10:14:26.718ZDEBGoximeter (clickhouse-client): unrolling 72 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1382024-02-23T10:14:26.722ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1392024-02-23T10:14:26.726ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 schema = {"timeseries_name":"oximeter_collector:collections","fields.name":["base_route","collector_id","collector_ip","collector_port","producer_id","producer_ip","producer_port"],"fields.type":["String","Uuid","IpAddr","U16","Uuid","IpAddr","U16"],"fields.source":["Metric","Target","Target","Target","Metric","Metric","Metric"],"datum_type":"CumulativeU64","created":"2024-02-23 10:14:26.722111793"} timeseries_name = oximeter_collector:collections
1402024-02-23T10:14:26.726ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1412024-02-23T10:14:26.729ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_i64
1422024-02-23T10:14:26.730ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 2 table_name = oximeter.fields_ipaddr
1432024-02-23T10:14:26.732ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 142 table_name = oximeter.fields_string
1442024-02-23T10:14:26.733ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 2 table_name = oximeter.fields_u16
1452024-02-23T10:14:26.734ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 61 table_name = oximeter.fields_uuid
1462024-02-23T10:14:26.736ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 37 table_name = oximeter.measurements_cumulativeu64
1472024-02-23T10:14:26.737ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.measurements_histogramf64
1482024-02-23T10:14:30.637ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = c2ae76c2-4598-48c6-9e61-c620a8f27348
1492024-02-23T10:14:30.639ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = c2ae76c2-4598-48c6-9e61-c620a8f27348
1502024-02-23T10:14:30.741ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = e9b22e1e-817f-48f9-983c-31451b7eeff5
1512024-02-23T10:14:30.742ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = e9b22e1e-817f-48f9-983c-31451b7eeff5
1522024-02-23T10:14:31.719ZDEBGoximeter (results-sink): inserting 27 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
1532024-02-23T10:14:31.719ZDEBGoximeter (clickhouse-client): unrolling 27 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1542024-02-23T10:14:31.722ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 12 table_name = oximeter.fields_i64
1552024-02-23T10:14:31.725ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 36 table_name = oximeter.fields_string
1562024-02-23T10:14:31.729ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 25 table_name = oximeter.fields_uuid
1572024-02-23T10:14:31.732ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 12 table_name = oximeter.measurements_histogramf64
1582024-02-23T10:14:31.735ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 15 table_name = oximeter.measurements_i64
1592024-02-23T10:14:32.627ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1602024-02-23T10:14:32.682ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1612024-02-23T10:14:32.682ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1622024-02-23T10:14:36.719ZDEBGoximeter (results-sink): inserting 36 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
1632024-02-23T10:14:36.719ZDEBGoximeter (clickhouse-client): unrolling 36 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1642024-02-23T10:14:36.723ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_i64
1652024-02-23T10:14:36.724ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 2 table_name = oximeter.fields_ipaddr
1662024-02-23T10:14:36.726ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 106 table_name = oximeter.fields_string
1672024-02-23T10:14:36.727ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 2 table_name = oximeter.fields_u16
1682024-02-23T10:14:36.728ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 37 table_name = oximeter.fields_uuid
1692024-02-23T10:14:36.730ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 1 table_name = oximeter.measurements_cumulativeu64
1702024-02-23T10:14:36.732ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.measurements_histogramf64
1712024-02-23T10:14:40.636ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = c2ae76c2-4598-48c6-9e61-c620a8f27348
1722024-02-23T10:14:40.638ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = c2ae76c2-4598-48c6-9e61-c620a8f27348
1732024-02-23T10:14:40.742ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = e9b22e1e-817f-48f9-983c-31451b7eeff5
1742024-02-23T10:14:40.742ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = e9b22e1e-817f-48f9-983c-31451b7eeff5
1752024-02-23T10:14:41.718ZDEBGoximeter (results-sink): inserting 14 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
1762024-02-23T10:14:41.718ZDEBGoximeter (clickhouse-client): unrolling 14 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1772024-02-23T10:14:41.721ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 14 table_name = oximeter.fields_i64
1782024-02-23T10:14:41.723ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 42 table_name = oximeter.fields_string
1792024-02-23T10:14:41.724ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 14 table_name = oximeter.fields_uuid
1802024-02-23T10:14:41.726ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 14 table_name = oximeter.measurements_histogramf64
1812024-02-23T10:14:42.627ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1822024-02-23T10:14:42.631ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
1832024-02-23T10:14:46.718ZDEBGoximeter (results-sink): inserting 35 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
1842024-02-23T10:14:46.718ZDEBGoximeter (clickhouse-client): unrolling 35 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1852024-02-23T10:14:46.722ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_i64
1862024-02-23T10:14:46.723ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 105 table_name = oximeter.fields_string
1872024-02-23T10:14:46.725ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_uuid
1882024-02-23T10:14:46.727ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.measurements_histogramf64
1892024-02-23T10:14:50.636ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = c2ae76c2-4598-48c6-9e61-c620a8f27348
1902024-02-23T10:14:50.637ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = c2ae76c2-4598-48c6-9e61-c620a8f27348
1912024-02-23T10:14:50.742ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = e9b22e1e-817f-48f9-983c-31451b7eeff5
1922024-02-23T10:14:50.743ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = e9b22e1e-817f-48f9-983c-31451b7eeff5
1932024-02-23T10:14:51.718ZDEBGoximeter (results-sink): inserting 14 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
1942024-02-23T10:14:51.718ZDEBGoximeter (clickhouse-client): unrolling 14 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
1952024-02-23T10:14:51.721ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 14 table_name = oximeter.fields_i64
1962024-02-23T10:14:51.723ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 42 table_name = oximeter.fields_string
1972024-02-23T10:14:51.724ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 14 table_name = oximeter.fields_uuid
1982024-02-23T10:14:51.725ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 14 table_name = oximeter.measurements_histogramf64
1992024-02-23T10:14:52.628ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
2002024-02-23T10:14:52.631ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 4 producer_id = 425b9f36-7430-43ea-9c6b-77c0f679a894
2012024-02-23T10:14:56.387ZDEBGoximeter (collection-task): collecting from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
2022024-02-23T10:14:56.388ZDEBGoximeter (collection-task): collected results from producer collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 n_results = 1 producer_id = 7b9d3c8c-ac1d-4177-bdff-d38dea37a7ee
2032024-02-23T10:14:56.718ZDEBGoximeter (results-sink): inserting 71 samples into database collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541
2042024-02-23T10:14:56.718ZDEBGoximeter (clickhouse-client): unrolling 71 total samples collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7
2052024-02-23T10:14:56.724ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.fields_i64
2062024-02-23T10:14:56.727ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 141 table_name = oximeter.fields_string
2072024-02-23T10:14:56.731ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 59 table_name = oximeter.fields_uuid
2082024-02-23T10:14:56.733ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 36 table_name = oximeter.measurements_cumulativeu64
2092024-02-23T10:14:56.735ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 0782e7a3-76a2-4968-83fc-5980b90c4541 id = 1854ef1e-1e7f-40cd-9bf6-7168a16290b7 n_rows = 35 table_name = oximeter.measurements_histogramf64