Max level shown:
1 [ Nov 30 02:12:57 Disabled. ]
2 [ Nov 30 02:12:57 Rereading configuration. ]
3 [ Nov 30 02:13:38 Rereading configuration. ]
4 [ Nov 30 02:13:38 Rereading configuration. ]
5 [ Nov 30 02:13:38 Enabled. ]
6 [ Nov 30 02:13:38 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 &"). ]
7 [ Nov 30 02:13:39 Method "start" exited with status 0. ]
8 note: configured to log to "/dev/stdout"
92023-11-30T02:13:39.075ZDEBGoximeter: registered DTrace probes
102023-11-30T02:13:39.076ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:192
112023-11-30T02:13:39.079ZINFOoximeter (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
122023-11-30T02:13:39.080ZDEBGoximeter: creating ClickHouse client
132023-11-30T02:13:39.080ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
142023-11-30T02:13:39.189ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 file = oximeter/db/src/client.rs:658 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
152023-11-30T02:13:39.190ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
162023-11-30T02:13:39.199ZINFOoximeter (clickhouse-client): reading db version collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 file = oximeter/db/src/client.rs:596 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
172023-11-30T02:13:39.200ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 file = oximeter/db/src/client.rs:658 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
182023-11-30T02:13:39.200ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 file = oximeter/db/src/client.rs:600 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb version = 0
192023-11-30T02:13:39.200ZINFOoximeter (clickhouse-client): wiping and re-initializing oximeter schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 file = oximeter/db/src/client.rs:605 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
202023-11-30T02:13:39.200ZDEBGoximeter (clickhouse-client): wiping ClickHouse database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
212023-11-30T02:13:39.201ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
222023-11-30T02:13:39.360ZINFOoximeter (clickhouse-client): inserting current version collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 file = oximeter/db/src/client.rs:628 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb version = 3
232023-11-30T02:13:39.373ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info
242023-11-30T02:13:39.374ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers
252023-11-30T02:13:39.374ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = POST path = /producers
262023-11-30T02:13:39.374ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id}
272023-11-30T02:13:39.374ZINFOoximeter (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:195 local_addr = [fd00:1122:3344:101::d]:12223
282023-11-30T02:13:39.374ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
292023-11-30T02:13:39.407ZDEBGoximeter: contacting nexus
302023-11-30T02:13:39.407ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
312023-11-30T02:13:39.408ZWARNoximeter: failed to contact nexus, will retry in 170.695478ms error = "error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:271
322023-11-30T02:13:39.580ZDEBGoximeter: contacting nexus
332023-11-30T02:13:39.580ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
342023-11-30T02:13:39.669ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:285 id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
352023-11-30T02:13:41.554ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:60146
362023-11-30T02:13:41.555ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:12345 collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = bc82077b-f165-4c2b-a6e7-2cd6416d9329
372023-11-30T02:13:41.555ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1406 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:60146 req_id = aec658ec-7435-4eae-afde-4286985fcac9 response_code = 204 uri = /producers
382023-11-30T02:13:41.588ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 interval = 30s producer_id = bc82077b-f165-4c2b-a6e7-2cd6416d9329
392023-11-30T02:13:55.756ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:34373
402023-11-30T02:13:55.756ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:12221 collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
412023-11-30T02:13:55.756ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 122 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:34373 req_id = b041e297-57bc-4d7c-8f10-f1b51c79f948 response_code = 204 uri = /producers
422023-11-30T02:13:55.789ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 interval = 10s producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
432023-11-30T02:14:05.789ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
442023-11-30T02:14:05.795ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
452023-11-30T02:14:09.371ZDEBGoximeter (results-sink): inserting 64 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
462023-11-30T02:14:09.371ZDEBGoximeter (clickhouse-client): unrolling 64 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
472023-11-30T02:14:09.377ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
482023-11-30T02:14:09.381ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"http_service:request_latency_histogram","fields.name":["id","method","name","route","status_code"],"fields.type":["Uuid","String","String","String","I64"],"fields.source":["Target","Metric","Target","Metric","Metric"],"datum_type":"HistogramF64","created":"2023-11-30 02:14:09.371124440"} timeseries_name = http_service:request_latency_histogram
492023-11-30T02:14:09.384ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
502023-11-30T02:14:09.393ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"collection_target:cpus_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2023-11-30 02:14:09.384061679"} timeseries_name = collection_target:cpus_provisioned
512023-11-30T02:14:09.393ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
522023-11-30T02:14:09.395ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"collection_target:ram_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2023-11-30 02:14:09.393092243"} timeseries_name = collection_target:ram_provisioned
532023-11-30T02:14:09.395ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
542023-11-30T02:14:09.396ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"collection_target:virtual_disk_space_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2023-11-30 02:14:09.395159703"} timeseries_name = collection_target:virtual_disk_space_provisioned
552023-11-30T02:14:09.398ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
562023-11-30T02:14:09.408ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 37 table_name = oximeter.fields_i64
572023-11-30T02:14:09.409ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 111 table_name = oximeter.fields_string
582023-11-30T02:14:09.414ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 49 table_name = oximeter.fields_uuid
592023-11-30T02:14:09.417ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 37 table_name = oximeter.measurements_histogramf64
602023-11-30T02:14:09.419ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 27 table_name = oximeter.measurements_i64
612023-11-30T02:14:10.676ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::a]:35756
622023-11-30T02:14:10.677ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::22]:52852 collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = e30152e9-9c9d-4465-b2fc-58fdc4e57164
632023-11-30T02:14:10.677ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 104 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::a]:35756 req_id = 1e5f49e3-ad01-462f-a210-5b86c49d0df1 response_code = 204 uri = /producers
642023-11-30T02:14:10.710ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 interval = 30s producer_id = e30152e9-9c9d-4465-b2fc-58fdc4e57164
652023-11-30T02:14:11.587ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = bc82077b-f165-4c2b-a6e7-2cd6416d9329
662023-11-30T02:14:11.594ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 1 producer_id = bc82077b-f165-4c2b-a6e7-2cd6416d9329
672023-11-30T02:14:14.371ZDEBGoximeter (results-sink): inserting 456 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
682023-11-30T02:14:14.371ZDEBGoximeter (clickhouse-client): unrolling 456 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
692023-11-30T02:14:14.371ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
702023-11-30T02:14:14.383ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"physical_data_link:errors_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2023-11-30 02:14:14.371540972"} timeseries_name = physical_data_link:errors_received
712023-11-30T02:14:14.383ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
722023-11-30T02:14:14.386ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"physical_data_link:errors_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2023-11-30 02:14:14.383518243"} timeseries_name = physical_data_link:errors_sent
732023-11-30T02:14:14.386ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
742023-11-30T02:14:14.388ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"physical_data_link:bytes_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2023-11-30 02:14:14.386066287"} timeseries_name = physical_data_link:bytes_received
752023-11-30T02:14:14.388ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
762023-11-30T02:14:14.391ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"physical_data_link:packets_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2023-11-30 02:14:14.388522759"} timeseries_name = physical_data_link:packets_received
772023-11-30T02:14:14.391ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
782023-11-30T02:14:14.393ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"physical_data_link:bytes_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2023-11-30 02:14:14.391060574"} timeseries_name = physical_data_link:bytes_sent
792023-11-30T02:14:14.393ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
802023-11-30T02:14:14.396ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"physical_data_link:packets_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2023-11-30 02:14:14.393509905"} timeseries_name = physical_data_link:packets_sent
812023-11-30T02:14:14.417ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
822023-11-30T02:14:14.420ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 36 table_name = oximeter.fields_string
832023-11-30T02:14:14.422ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 24 table_name = oximeter.fields_uuid
842023-11-30T02:14:14.423ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 456 table_name = oximeter.measurements_cumulativeu64
852023-11-30T02:14:15.789ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
862023-11-30T02:14:15.792ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
872023-11-30T02:14:19.371ZDEBGoximeter (results-sink): inserting 42 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
882023-11-30T02:14:19.371ZDEBGoximeter (clickhouse-client): unrolling 42 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
892023-11-30T02:14:19.376ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_i64
902023-11-30T02:14:19.377ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 126 table_name = oximeter.fields_string
912023-11-30T02:14:19.379ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_uuid
922023-11-30T02:14:19.381ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.measurements_histogramf64
932023-11-30T02:14:25.789ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
942023-11-30T02:14:25.852ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
952023-11-30T02:14:29.371ZDEBGoximeter (results-sink): inserting 42 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
962023-11-30T02:14:29.371ZDEBGoximeter (clickhouse-client): unrolling 42 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
972023-11-30T02:14:29.376ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_i64
982023-11-30T02:14:29.378ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 126 table_name = oximeter.fields_string
992023-11-30T02:14:29.379ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_uuid
1002023-11-30T02:14:29.381ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.measurements_histogramf64
1012023-11-30T02:14:35.789ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
1022023-11-30T02:14:35.793ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
1032023-11-30T02:14:39.371ZDEBGoximeter (results-sink): inserting 42 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
1042023-11-30T02:14:39.371ZDEBGoximeter (clickhouse-client): unrolling 42 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1052023-11-30T02:14:39.376ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_i64
1062023-11-30T02:14:39.378ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 126 table_name = oximeter.fields_string
1072023-11-30T02:14:39.379ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_uuid
1082023-11-30T02:14:39.381ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.measurements_histogramf64
1092023-11-30T02:14:39.815ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::a]:51222
1102023-11-30T02:14:39.815ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:12221 collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 90d09110-8766-4c74-ab90-22845880fcb6
1112023-11-30T02:14:39.815ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 89 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::a]:51222 req_id = 9b971c76-46b8-4e26-a40e-3b3f30b472a4 response_code = 204 uri = /producers
1122023-11-30T02:14:39.846ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 interval = 10s producer_id = 90d09110-8766-4c74-ab90-22845880fcb6
1132023-11-30T02:14:39.896ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:34065
1142023-11-30T02:14:39.896ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:12221 collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 44e366d2-5b45-468f-95ec-0531a83b28fa
1152023-11-30T02:14:39.896ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 75 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:34065 req_id = 6fbae976-3f0b-4b5e-bb98-1022b3c84168 response_code = 204 uri = /producers
1162023-11-30T02:14:39.929ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 interval = 10s producer_id = 44e366d2-5b45-468f-95ec-0531a83b28fa
1172023-11-30T02:14:40.710ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = e30152e9-9c9d-4465-b2fc-58fdc4e57164
1182023-11-30T02:14:40.711ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 2 producer_id = e30152e9-9c9d-4465-b2fc-58fdc4e57164
1192023-11-30T02:14:41.588ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = bc82077b-f165-4c2b-a6e7-2cd6416d9329
1202023-11-30T02:14:41.589ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 1 producer_id = bc82077b-f165-4c2b-a6e7-2cd6416d9329
1212023-11-30T02:14:41.589ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = bc82077b-f165-4c2b-a6e7-2cd6416d9329
1222023-11-30T02:14:44.371ZDEBGoximeter (results-sink): inserting 48 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
1232023-11-30T02:14:44.371ZDEBGoximeter (clickhouse-client): unrolling 48 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1242023-11-30T02:14:44.371ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1252023-11-30T02:14:44.375ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"instance_uuid:reset","fields.name":["uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.371076422"} timeseries_name = instance_uuid:reset
1262023-11-30T02:14:44.375ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1272023-11-30T02:14:44.379ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:activated","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.375595805"} timeseries_name = crucible_upstairs:activated
1282023-11-30T02:14:44.379ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1292023-11-30T02:14:44.382ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:flush","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.379173909"} timeseries_name = crucible_upstairs:flush
1302023-11-30T02:14:44.382ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1312023-11-30T02:14:44.386ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:write","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.382647151"} timeseries_name = crucible_upstairs:write
1322023-11-30T02:14:44.386ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1332023-11-30T02:14:44.389ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:write_bytes","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.386177324"} timeseries_name = crucible_upstairs:write_bytes
1342023-11-30T02:14:44.389ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1352023-11-30T02:14:44.393ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:read","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.389804300"} timeseries_name = crucible_upstairs:read
1362023-11-30T02:14:44.393ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1372023-11-30T02:14:44.396ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:read_bytes","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.393014394"} timeseries_name = crucible_upstairs:read_bytes
1382023-11-30T02:14:44.396ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1392023-11-30T02:14:44.399ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:flush_close","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.396213318"} timeseries_name = crucible_upstairs:flush_close
1402023-11-30T02:14:44.399ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1412023-11-30T02:14:44.403ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:extent_repair","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.399524825"} timeseries_name = crucible_upstairs:extent_repair
1422023-11-30T02:14:44.403ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1432023-11-30T02:14:44.406ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:extent_no_op","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.403067599"} timeseries_name = crucible_upstairs:extent_no_op
1442023-11-30T02:14:44.406ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1452023-11-30T02:14:44.409ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"crucible_upstairs:extent_reopen","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-30 02:14:44.406476829"} timeseries_name = crucible_upstairs:extent_reopen
1462023-11-30T02:14:44.412ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1472023-11-30T02:14:44.415ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb schema = {"timeseries_name":"oximeter_collector:collections","fields.name":["base_route","collector_id","collector_ip","collector_port","producer_id","producer_ip","producer_port"],"fields.type":["String","Uuid","IpAddr","U16","Uuid","IpAddr","U16"],"fields.source":["Metric","Target","Target","Target","Metric","Metric","Metric"],"datum_type":"CumulativeU64","created":"2023-11-30 02:14:44.411941689"} timeseries_name = oximeter_collector:collections
1482023-11-30T02:14:44.415ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1492023-11-30T02:14:44.418ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 2 table_name = oximeter.fields_ipaddr
1502023-11-30T02:14:44.420ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 37 table_name = oximeter.fields_string
1512023-11-30T02:14:44.424ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 2 table_name = oximeter.fields_u16
1522023-11-30T02:14:44.425ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 37 table_name = oximeter.fields_uuid
1532023-11-30T02:14:44.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 11 table_name = oximeter.measurements_cumulativei64
1542023-11-30T02:14:44.430ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 37 table_name = oximeter.measurements_cumulativeu64
1552023-11-30T02:14:45.789ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
1562023-11-30T02:14:45.792ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
1572023-11-30T02:14:49.370ZDEBGoximeter (results-sink): inserting 42 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
1582023-11-30T02:14:49.370ZDEBGoximeter (clickhouse-client): unrolling 42 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1592023-11-30T02:14:49.375ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_i64
1602023-11-30T02:14:49.377ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 126 table_name = oximeter.fields_string
1612023-11-30T02:14:49.378ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_uuid
1622023-11-30T02:14:49.380ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.measurements_histogramf64
1632023-11-30T02:14:49.847ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 90d09110-8766-4c74-ab90-22845880fcb6
1642023-11-30T02:14:49.848ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 90d09110-8766-4c74-ab90-22845880fcb6
1652023-11-30T02:14:49.929ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 44e366d2-5b45-468f-95ec-0531a83b28fa
1662023-11-30T02:14:49.930ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 44e366d2-5b45-468f-95ec-0531a83b28fa
1672023-11-30T02:14:54.371ZDEBGoximeter (results-sink): inserting 11 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
1682023-11-30T02:14:54.371ZDEBGoximeter (clickhouse-client): unrolling 11 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1692023-11-30T02:14:54.374ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 5 table_name = oximeter.fields_i64
1702023-11-30T02:14:54.377ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 15 table_name = oximeter.fields_string
1712023-11-30T02:14:54.379ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 11 table_name = oximeter.fields_uuid
1722023-11-30T02:14:54.380ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 5 table_name = oximeter.measurements_histogramf64
1732023-11-30T02:14:54.384ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 6 table_name = oximeter.measurements_i64
1742023-11-30T02:14:55.789ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
1752023-11-30T02:14:55.793ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
1762023-11-30T02:14:55.793ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 39f17bc0-ce39-490a-a333-8c48d29a9610
1772023-11-30T02:14:59.370ZDEBGoximeter (results-sink): inserting 43 samples into database collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7
1782023-11-30T02:14:59.370ZDEBGoximeter (clickhouse-client): unrolling 43 total samples collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb
1792023-11-30T02:14:59.375ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.fields_i64
1802023-11-30T02:14:59.377ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 2 table_name = oximeter.fields_ipaddr
1812023-11-30T02:14:59.378ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 127 table_name = oximeter.fields_string
1822023-11-30T02:14:59.379ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 2 table_name = oximeter.fields_u16
1832023-11-30T02:14:59.381ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 44 table_name = oximeter.fields_uuid
1842023-11-30T02:14:59.382ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 1 table_name = oximeter.measurements_cumulativeu64
1852023-11-30T02:14:59.384ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 id = 2efb38f3-4542-42a6-af8a-5b1b3d10f4cb n_rows = 42 table_name = oximeter.measurements_histogramf64
1862023-11-30T02:14:59.847ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 90d09110-8766-4c74-ab90-22845880fcb6
1872023-11-30T02:14:59.848ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 90d09110-8766-4c74-ab90-22845880fcb6
1882023-11-30T02:14:59.928ZDEBGoximeter (collection-task): collecting from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 producer_id = 44e366d2-5b45-468f-95ec-0531a83b28fa
1892023-11-30T02:14:59.929ZDEBGoximeter (collection-task): collected results from producer collector_id = 83ddb671-4afb-48de-87d5-6fa1cfee8ea7 n_results = 3 producer_id = 44e366d2-5b45-468f-95ec-0531a83b28fa