Max level shown:
1 [ Aug 1 05:13:26 Enabled. ]
2 [ Aug 1 05:13:26 Rereading configuration. ]
3 [ Aug 1 05:13:30 Rereading configuration. ]
4 [ Aug 1 05:13:34 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 92f84514-0948-4db1-a30c-ef7b7d8b090c &"). ]
5 [ Aug 1 05:13:34 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-08-01T05:13:34.626ZDEBGoximeter: registered DTrace probes
82024-08-01T05:13:34.645ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:194
92024-08-01T05:13:34.663ZINFOoximeter (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
102024-08-01T05:13:34.675ZDEBGoximeter: creating ClickHouse client
112024-08-01T05:13:34.675ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
122024-08-01T05:13:34.853ZWARNoximeter (clickhouse-client): failed to read version collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:707 id = a73a2a96-dfff-4890-9eda-ae4416859f26
132024-08-01T05:13:34.854ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 186.292309ms
142024-08-01T05:13:35.041ZDEBGoximeter: creating ClickHouse client
152024-08-01T05:13:35.041ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
162024-08-01T05:13:35.095ZWARNoximeter (clickhouse-client): failed to read version collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:707 id = 63a76a19-63a3-4073-9983-29a99dd59d8e
172024-08-01T05:13:35.097ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 640.018221ms
182024-08-01T05:13:35.738ZDEBGoximeter: creating ClickHouse client
192024-08-01T05:13:35.738ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
202024-08-01T05:13:35.769ZWARNoximeter (clickhouse-client): failed to read version collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:707 id = 7ed9fd14-0f9b-4e05-86d4-eebaaa02feb4
212024-08-01T05:13:35.769ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 652.063486ms
222024-08-01T05:13:36.422ZDEBGoximeter: creating ClickHouse client
232024-08-01T05:13:36.422ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
242024-08-01T05:13:36.454ZWARNoximeter (clickhouse-client): failed to read version collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:707 id = 464da999-8a46-4d56-a094-21568116c2fd
252024-08-01T05:13:36.454ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 2.027250168s
262024-08-01T05:13:38.482ZDEBGoximeter: creating ClickHouse client
272024-08-01T05:13:38.482ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
282024-08-01T05:13:38.513ZWARNoximeter (clickhouse-client): failed to read version collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:707 id = ae7d3ee0-3720-4a52-8f1a-ad81ab086ed1
292024-08-01T05:13:38.514ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 5.40181466s
302024-08-01T05:13:43.916ZDEBGoximeter: creating ClickHouse client
312024-08-01T05:13:43.916ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
322024-08-01T05:13:44.002ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:703 id = 1655834f-36c9-4345-b563-0045286753f0
332024-08-01T05:13:44.002ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
342024-08-01T05:13:44.024ZINFOoximeter (clickhouse-client): reading db version collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:641 id = 1655834f-36c9-4345-b563-0045286753f0
352024-08-01T05:13:44.025ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:703 id = 1655834f-36c9-4345-b563-0045286753f0
362024-08-01T05:13:44.025ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:645 id = 1655834f-36c9-4345-b563-0045286753f0 version = 0
372024-08-01T05:13:44.025ZINFOoximeter (clickhouse-client): wiping and re-initializing oximeter schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:650 id = 1655834f-36c9-4345-b563-0045286753f0
382024-08-01T05:13:44.025ZDEBGoximeter (clickhouse-client): wiping ClickHouse database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
392024-08-01T05:13:44.026ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
402024-08-01T05:13:45.436ZINFOoximeter (clickhouse-client): inserting current version collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:673 id = 1655834f-36c9-4345-b563-0045286753f0 version = 6
412024-08-01T05:13:45.459ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info
422024-08-01T05:13:45.459ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers
432024-08-01T05:13:45.459ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = POST path = /producers
442024-08-01T05:13:45.459ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id}
452024-08-01T05:13:45.459ZINFOoximeter (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::d]:12223
462024-08-01T05:13:45.459ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
472024-08-01T05:13:45.459ZDEBGoximeter: contacting nexus
482024-08-01T05:13:45.459ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
492024-08-01T05:13:45.496ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
502024-08-01T05:13:45.496ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
512024-08-01T05:13:45.497ZWARNoximeter: failed to contact nexus, will retry in 185.605033ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
522024-08-01T05:13:45.683ZDEBGoximeter: contacting nexus
532024-08-01T05:13:45.683ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
542024-08-01T05:13:45.713ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
552024-08-01T05:13:45.713ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
562024-08-01T05:13:45.714ZWARNoximeter: failed to contact nexus, will retry in 427.522158ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
572024-08-01T05:13:46.142ZDEBGoximeter: contacting nexus
582024-08-01T05:13:46.142ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
592024-08-01T05:13:46.171ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
602024-08-01T05:13:46.172ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
612024-08-01T05:13:46.172ZWARNoximeter: failed to contact nexus, will retry in 1.426388596s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
622024-08-01T05:13:47.599ZDEBGoximeter: contacting nexus
632024-08-01T05:13:47.599ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
642024-08-01T05:13:47.629ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
652024-08-01T05:13:47.629ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
662024-08-01T05:13:47.629ZWARNoximeter: failed to contact nexus, will retry in 1.076631591s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
672024-08-01T05:13:48.707ZDEBGoximeter: contacting nexus
682024-08-01T05:13:48.707ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
692024-08-01T05:13:48.737ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
702024-08-01T05:13:48.737ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
712024-08-01T05:13:48.738ZWARNoximeter: failed to contact nexus, will retry in 5.008308055s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
722024-08-01T05:13:53.747ZDEBGoximeter: contacting nexus
732024-08-01T05:13:53.747ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
742024-08-01T05:13:53.778ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
752024-08-01T05:13:53.829ZDEBGoximeter: client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e66cba20-8072-46f1-aa41-d1a298d946df", "date": "Thu, 01 Aug 2024 05:13:53 GMT"} })
762024-08-01T05:13:53.830ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:302 id = 92f84514-0948-4db1-a30c-ef7b7d8b090c
772024-08-01T05:13:53.834ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:757
782024-08-01T05:13:53.834ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
792024-08-01T05:13:53.878ZDEBGoximeter (oximeter-agent): client request body = None collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/92f84514-0948-4db1-a30c-ef7b7d8b090c/producers?sort_by=id_ascending
802024-08-01T05:13:53.881ZDEBGoximeter (oximeter-agent): client response collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors/92f84514-0948-4db1-a30c-ef7b7d8b090c/producers", query: Some("sort_by=id_ascending"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4fbff50a-43a1-4dc7-9238-c26504436a0f", "content-length": "29", "date": "Thu, 01 Aug 2024 05:13:53 GMT"} })
812024-08-01T05:13:53.883ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:807 n_current_tasks = 0 n_pruned_tasks = 0
822024-08-01T05:13:57.556ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:39797
832024-08-01T05:13:57.565ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:59955 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 67dd4f1f-c652-4865-960b-b463df992960
842024-08-01T05:13:57.565ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 8072 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:39797 req_id = 051e22b7-c2f0-4234-8895-29723ddf7d6a response_code = 204 uri = /producers
852024-08-01T05:13:57.595ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::1]:59955 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 67dd4f1f-c652-4865-960b-b463df992960
862024-08-01T05:13:58.504ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:37319
872024-08-01T05:13:58.504ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
882024-08-01T05:13:58.505ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:37319 req_id = 6d00087f-9dbd-466f-9790-874683ed9ea8 response_code = 204 uri = /producers
892024-08-01T05:13:58.538ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
902024-08-01T05:14:08.538ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
912024-08-01T05:14:08.591ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
922024-08-01T05:14:10.450ZDEBGoximeter (results-sink): inserting 36 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
932024-08-01T05:14:10.450ZDEBGoximeter (clickhouse-client): unrolling 36 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
942024-08-01T05:14:10.450ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
952024-08-01T05:14:10.465ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"http_service:request_latency_histogram","fields.name":["id","method","name","route","status_code"],"fields.type":["Uuid","String","String","String","I64"],"fields.source":["Target","Metric","Target","Metric","Metric"],"datum_type":"HistogramF64","created":"2024-08-01 05:14:10.450325796"} timeseries_name = http_service:request_latency_histogram
962024-08-01T05:14:10.472ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
972024-08-01T05:14:10.496ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"collection_target:cpus_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-08-01 05:14:10.472348334"} timeseries_name = collection_target:cpus_provisioned
982024-08-01T05:14:10.498ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
992024-08-01T05:14:10.502ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"collection_target:ram_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-08-01 05:14:10.498651763"} timeseries_name = collection_target:ram_provisioned
1002024-08-01T05:14:10.502ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1012024-08-01T05:14:10.504ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"collection_target:virtual_disk_space_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-08-01 05:14:10.502924034"} timeseries_name = collection_target:virtual_disk_space_provisioned
1022024-08-01T05:14:10.505ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1032024-08-01T05:14:10.506ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"database_transaction:retry_data","fields.name":["attempt","name"],"fields.type":["U32","String"],"fields.source":["Metric","Target"],"datum_type":"F64","created":"2024-08-01 05:14:10.505280305"} timeseries_name = database_transaction:retry_data
1042024-08-01T05:14:10.507ZDEBGoximeter (clickhouse-client): inserting 5 new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1052024-08-01T05:14:10.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 20 table_name = oximeter.fields_i64
1062024-08-01T05:14:10.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 61 table_name = oximeter.fields_string
1072024-08-01T05:14:10.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 1 table_name = oximeter.fields_u32
1082024-08-01T05:14:10.547ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 29 table_name = oximeter.fields_uuid
1092024-08-01T05:14:10.556ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 1 table_name = oximeter.measurements_f64
1102024-08-01T05:14:10.563ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 20 table_name = oximeter.measurements_histogramf64
1112024-08-01T05:14:10.567ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 15 table_name = oximeter.measurements_i64
1122024-08-01T05:14:12.402ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:59526
1132024-08-01T05:14:12.402ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1142024-08-01T05:14:12.402ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 81 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:59526 req_id = 6be3d3e1-dd02-4b47-8719-d1bdd55bac3c response_code = 204 uri = /producers
1152024-08-01T05:14:12.434ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d interval = 1s producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1162024-08-01T05:14:13.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1172024-08-01T05:14:13.443ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1182024-08-01T05:14:14.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1192024-08-01T05:14:14.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1202024-08-01T05:14:15.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1212024-08-01T05:14:15.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1222024-08-01T05:14:15.449ZDEBGoximeter (results-sink): inserting 78 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
1232024-08-01T05:14:15.449ZDEBGoximeter (clickhouse-client): unrolling 78 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1242024-08-01T05:14:15.449ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1252024-08-01T05:14:15.494ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_router:originated_underlay_prefixes","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"U64","created":"2024-08-01 05:14:15.449637664"} timeseries_name = ddm_router:originated_underlay_prefixes
1262024-08-01T05:14:15.494ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1272024-08-01T05:14:15.496ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_router:originated_tunnel_endpoints","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"U64","created":"2024-08-01 05:14:15.494136193"} timeseries_name = ddm_router:originated_tunnel_endpoints
1282024-08-01T05:14:15.496ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1292024-08-01T05:14:15.498ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:solicitations_sent","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.496631087"} timeseries_name = ddm_session:solicitations_sent
1302024-08-01T05:14:15.499ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1312024-08-01T05:14:15.501ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:solicitations_received","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.499011139"} timeseries_name = ddm_session:solicitations_received
1322024-08-01T05:14:15.501ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1332024-08-01T05:14:15.504ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:advertisements_sent","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.501718699"} timeseries_name = ddm_session:advertisements_sent
1342024-08-01T05:14:15.504ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1352024-08-01T05:14:15.506ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:advertisements_received","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.504212283"} timeseries_name = ddm_session:advertisements_received
1362024-08-01T05:14:15.506ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1372024-08-01T05:14:15.508ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:peer_expirations","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.506514742"} timeseries_name = ddm_session:peer_expirations
1382024-08-01T05:14:15.508ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1392024-08-01T05:14:15.511ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:peer_address_changes","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.508950635"} timeseries_name = ddm_session:peer_address_changes
1402024-08-01T05:14:15.511ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1412024-08-01T05:14:15.513ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:peer_sessions_established","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.511589864"} timeseries_name = ddm_session:peer_sessions_established
1422024-08-01T05:14:15.514ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1432024-08-01T05:14:15.516ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:updates_sent","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.514029196"} timeseries_name = ddm_session:updates_sent
1442024-08-01T05:14:15.516ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1452024-08-01T05:14:15.519ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:updates_received","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.516745887"} timeseries_name = ddm_session:updates_received
1462024-08-01T05:14:15.519ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1472024-08-01T05:14:15.521ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:update_send_fail","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:15.519337113"} timeseries_name = ddm_session:update_send_fail
1482024-08-01T05:14:15.521ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1492024-08-01T05:14:15.524ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:imported_underlay_prefixes","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"U64","created":"2024-08-01 05:14:15.521737886"} timeseries_name = ddm_session:imported_underlay_prefixes
1502024-08-01T05:14:15.524ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1512024-08-01T05:14:15.526ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"ddm_session:imported_tunnel_endpoints","fields.name":["hostname","interface","rack_id","sled_id"],"fields.type":["String","String","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target"],"datum_type":"U64","created":"2024-08-01 05:14:15.524379904"} timeseries_name = ddm_session:imported_tunnel_endpoints
1522024-08-01T05:14:15.529ZDEBGoximeter (clickhouse-client): inserting 14 new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1532024-08-01T05:14:15.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 26 table_name = oximeter.fields_string
1542024-08-01T05:14:15.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 28 table_name = oximeter.fields_uuid
1552024-08-01T05:14:15.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 60 table_name = oximeter.measurements_cumulativeu64
1562024-08-01T05:14:15.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 18 table_name = oximeter.measurements_u64
1572024-08-01T05:14:16.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1582024-08-01T05:14:16.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1592024-08-01T05:14:17.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1602024-08-01T05:14:17.437ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1612024-08-01T05:14:18.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1622024-08-01T05:14:18.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1632024-08-01T05:14:18.538ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
1642024-08-01T05:14:18.542ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
1652024-08-01T05:14:19.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1662024-08-01T05:14:19.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1672024-08-01T05:14:20.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1682024-08-01T05:14:20.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1692024-08-01T05:14:20.449ZDEBGoximeter (results-sink): inserting 150 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
1702024-08-01T05:14:20.449ZDEBGoximeter (clickhouse-client): unrolling 150 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1712024-08-01T05:14:20.458ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 20 table_name = oximeter.fields_i64
1722024-08-01T05:14:20.460ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 86 table_name = oximeter.fields_string
1732024-08-01T05:14:20.462ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 48 table_name = oximeter.fields_uuid
1742024-08-01T05:14:20.465ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 100 table_name = oximeter.measurements_cumulativeu64
1752024-08-01T05:14:20.468ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 20 table_name = oximeter.measurements_histogramf64
1762024-08-01T05:14:20.470ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 30 table_name = oximeter.measurements_u64
1772024-08-01T05:14:21.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1782024-08-01T05:14:21.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1792024-08-01T05:14:22.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1802024-08-01T05:14:22.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1812024-08-01T05:14:23.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1822024-08-01T05:14:23.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1832024-08-01T05:14:24.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1842024-08-01T05:14:24.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1852024-08-01T05:14:25.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1862024-08-01T05:14:25.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1872024-08-01T05:14:25.450ZDEBGoximeter (results-sink): inserting 130 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
1882024-08-01T05:14:25.450ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
1892024-08-01T05:14:25.457ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 26 table_name = oximeter.fields_string
1902024-08-01T05:14:25.459ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 28 table_name = oximeter.fields_uuid
1912024-08-01T05:14:25.461ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 100 table_name = oximeter.measurements_cumulativeu64
1922024-08-01T05:14:25.463ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 30 table_name = oximeter.measurements_u64
1932024-08-01T05:14:26.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1942024-08-01T05:14:26.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1952024-08-01T05:14:27.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1962024-08-01T05:14:27.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
1972024-08-01T05:14:27.596ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:59955 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 67dd4f1f-c652-4865-960b-b463df992960
1982024-08-01T05:14:27.620ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:59955 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 67dd4f1f-c652-4865-960b-b463df992960
1992024-08-01T05:14:28.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2002024-08-01T05:14:28.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2012024-08-01T05:14:28.538ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
2022024-08-01T05:14:28.542ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
2032024-08-01T05:14:29.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2042024-08-01T05:14:29.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2052024-08-01T05:14:30.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2062024-08-01T05:14:30.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2072024-08-01T05:14:30.449ZDEBGoximeter (results-sink): inserting 427 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
2082024-08-01T05:14:30.449ZDEBGoximeter (clickhouse-client): unrolling 427 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2092024-08-01T05:14:30.451ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2102024-08-01T05:14:30.460ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"physical_data_link:errors_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:30.451909610"} timeseries_name = physical_data_link:errors_received
2112024-08-01T05:14:30.460ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2122024-08-01T05:14:30.463ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"physical_data_link:errors_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:30.460415750"} timeseries_name = physical_data_link:errors_sent
2132024-08-01T05:14:30.464ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2142024-08-01T05:14:30.467ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"physical_data_link:bytes_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:30.464012643"} timeseries_name = physical_data_link:bytes_received
2152024-08-01T05:14:30.467ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2162024-08-01T05:14:30.470ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"physical_data_link:packets_received","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:30.467302428"} timeseries_name = physical_data_link:packets_received
2172024-08-01T05:14:30.470ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2182024-08-01T05:14:30.473ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"physical_data_link:bytes_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:30.470625783"} timeseries_name = physical_data_link:bytes_sent
2192024-08-01T05:14:30.473ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2202024-08-01T05:14:30.476ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"physical_data_link:packets_sent","fields.name":["hostname","link_name","rack_id","serial","sled_id"],"fields.type":["String","String","Uuid","String","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:30.473918588"} timeseries_name = physical_data_link:packets_sent
2212024-08-01T05:14:30.490ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2222024-08-01T05:14:30.495ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 21 table_name = oximeter.fields_i64
2232024-08-01T05:14:30.497ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 125 table_name = oximeter.fields_string
2242024-08-01T05:14:30.499ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 73 table_name = oximeter.fields_uuid
2252024-08-01T05:14:30.501ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 376 table_name = oximeter.measurements_cumulativeu64
2262024-08-01T05:14:30.505ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 21 table_name = oximeter.measurements_histogramf64
2272024-08-01T05:14:30.507ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 30 table_name = oximeter.measurements_u64
2282024-08-01T05:14:31.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2292024-08-01T05:14:31.437ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2302024-08-01T05:14:32.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2312024-08-01T05:14:32.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2322024-08-01T05:14:33.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2332024-08-01T05:14:33.437ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2342024-08-01T05:14:34.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2352024-08-01T05:14:34.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2362024-08-01T05:14:35.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2372024-08-01T05:14:35.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2382024-08-01T05:14:35.449ZDEBGoximeter (results-sink): inserting 130 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
2392024-08-01T05:14:35.449ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2402024-08-01T05:14:35.457ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 26 table_name = oximeter.fields_string
2412024-08-01T05:14:35.460ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 28 table_name = oximeter.fields_uuid
2422024-08-01T05:14:35.472ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 100 table_name = oximeter.measurements_cumulativeu64
2432024-08-01T05:14:35.475ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 30 table_name = oximeter.measurements_u64
2442024-08-01T05:14:36.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2452024-08-01T05:14:36.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2462024-08-01T05:14:37.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2472024-08-01T05:14:37.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2482024-08-01T05:14:38.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2492024-08-01T05:14:38.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2502024-08-01T05:14:38.537ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
2512024-08-01T05:14:38.542ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
2522024-08-01T05:14:39.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2532024-08-01T05:14:39.437ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2542024-08-01T05:14:40.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2552024-08-01T05:14:40.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2562024-08-01T05:14:40.449ZDEBGoximeter (results-sink): inserting 151 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
2572024-08-01T05:14:40.450ZDEBGoximeter (clickhouse-client): unrolling 151 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2582024-08-01T05:14:40.459ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 21 table_name = oximeter.fields_i64
2592024-08-01T05:14:40.461ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 89 table_name = oximeter.fields_string
2602024-08-01T05:14:40.463ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 49 table_name = oximeter.fields_uuid
2612024-08-01T05:14:40.465ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 100 table_name = oximeter.measurements_cumulativeu64
2622024-08-01T05:14:40.473ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 21 table_name = oximeter.measurements_histogramf64
2632024-08-01T05:14:40.476ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 30 table_name = oximeter.measurements_u64
2642024-08-01T05:14:41.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2652024-08-01T05:14:41.437ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2662024-08-01T05:14:42.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2672024-08-01T05:14:42.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2682024-08-01T05:14:43.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2692024-08-01T05:14:43.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2702024-08-01T05:14:44.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2712024-08-01T05:14:44.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2722024-08-01T05:14:45.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2732024-08-01T05:14:45.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2742024-08-01T05:14:45.449ZDEBGoximeter (results-sink): inserting 130 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
2752024-08-01T05:14:45.449ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
2762024-08-01T05:14:45.456ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 26 table_name = oximeter.fields_string
2772024-08-01T05:14:45.459ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 28 table_name = oximeter.fields_uuid
2782024-08-01T05:14:45.461ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 100 table_name = oximeter.measurements_cumulativeu64
2792024-08-01T05:14:45.463ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 30 table_name = oximeter.measurements_u64
2802024-08-01T05:14:45.914ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:54027
2812024-08-01T05:14:45.915ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
2822024-08-01T05:14:45.915ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 604 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:54027 req_id = 385cd261-ff2e-4abb-86a5-7fd3936bf3fa response_code = 204 uri = /producers
2832024-08-01T05:14:45.947ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d interval = 1s producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
2842024-08-01T05:14:46.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2852024-08-01T05:14:46.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2862024-08-01T05:14:46.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
2872024-08-01T05:14:46.955ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
2882024-08-01T05:14:47.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2892024-08-01T05:14:47.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2902024-08-01T05:14:47.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
2912024-08-01T05:14:47.952ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
2922024-08-01T05:14:48.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2932024-08-01T05:14:48.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2942024-08-01T05:14:48.537ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
2952024-08-01T05:14:48.541ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
2962024-08-01T05:14:48.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
2972024-08-01T05:14:48.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
2982024-08-01T05:14:49.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
2992024-08-01T05:14:49.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3002024-08-01T05:14:49.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3012024-08-01T05:14:49.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3022024-08-01T05:14:50.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3032024-08-01T05:14:50.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3042024-08-01T05:14:50.450ZDEBGoximeter (results-sink): inserting 167 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
3052024-08-01T05:14:50.450ZDEBGoximeter (clickhouse-client): unrolling 167 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3062024-08-01T05:14:50.451ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3072024-08-01T05:14:50.456ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"static_routing_config:static_routes","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:50.451189715"} timeseries_name = static_routing_config:static_routes
3082024-08-01T05:14:50.456ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3092024-08-01T05:14:50.460ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"static_routing_config:static_nexthops","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-08-01 05:14:50.456855781"} timeseries_name = static_routing_config:static_nexthops
3102024-08-01T05:14:50.460ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3112024-08-01T05:14:50.464ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"switch_rib:active_routes","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"U64","created":"2024-08-01 05:14:50.460869325"} timeseries_name = switch_rib:active_routes
3122024-08-01T05:14:50.465ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3132024-08-01T05:14:50.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"mg_lower:routes_blocked_by_link_state","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"U64","created":"2024-08-01 05:14:50.465028612"} timeseries_name = mg_lower:routes_blocked_by_link_state
3142024-08-01T05:14:50.474ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3152024-08-01T05:14:50.478ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 21 table_name = oximeter.fields_i64
3162024-08-01T05:14:50.480ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 93 table_name = oximeter.fields_string
3172024-08-01T05:14:50.482ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 57 table_name = oximeter.fields_uuid
3182024-08-01T05:14:50.484ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 108 table_name = oximeter.measurements_cumulativeu64
3192024-08-01T05:14:50.488ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 21 table_name = oximeter.measurements_histogramf64
3202024-08-01T05:14:50.489ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 38 table_name = oximeter.measurements_u64
3212024-08-01T05:14:50.948ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3222024-08-01T05:14:50.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3232024-08-01T05:14:51.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3242024-08-01T05:14:51.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3252024-08-01T05:14:51.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3262024-08-01T05:14:51.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3272024-08-01T05:14:52.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3282024-08-01T05:14:52.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3292024-08-01T05:14:52.948ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3302024-08-01T05:14:52.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3312024-08-01T05:14:53.397ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::a]:54914
3322024-08-01T05:14:53.397ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:43521 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 2f888246-b273-44e6-ad3e-5bcd759c4926
3332024-08-01T05:14:53.397ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 661 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::a]:54914 req_id = a3c3baea-5ba7-4e9a-bf40-700c1f160bbf response_code = 204 uri = /producers
3342024-08-01T05:14:53.430ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::a]:43521 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 2f888246-b273-44e6-ad3e-5bcd759c4926
3352024-08-01T05:14:53.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3362024-08-01T05:14:53.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3372024-08-01T05:14:53.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3382024-08-01T05:14:53.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3392024-08-01T05:14:54.294ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:52924
3402024-08-01T05:14:54.294ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:44990 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = a18d61d4-7a53-4fa9-aa91-9b6d1e0cca06
3412024-08-01T05:14:54.294ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:52924 req_id = ea9becdb-3003-42a8-ae29-83f341af4687 response_code = 204 uri = /producers
3422024-08-01T05:14:54.328ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::c]:44990 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = a18d61d4-7a53-4fa9-aa91-9b6d1e0cca06
3432024-08-01T05:14:54.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3442024-08-01T05:14:54.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3452024-08-01T05:14:54.948ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3462024-08-01T05:14:54.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3472024-08-01T05:14:55.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3482024-08-01T05:14:55.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3492024-08-01T05:14:55.449ZDEBGoximeter (results-sink): inserting 150 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
3502024-08-01T05:14:55.449ZDEBGoximeter (clickhouse-client): unrolling 150 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3512024-08-01T05:14:55.457ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 30 table_name = oximeter.fields_string
3522024-08-01T05:14:55.459ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 36 table_name = oximeter.fields_uuid
3532024-08-01T05:14:55.461ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 110 table_name = oximeter.measurements_cumulativeu64
3542024-08-01T05:14:55.463ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 40 table_name = oximeter.measurements_u64
3552024-08-01T05:14:55.948ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3562024-08-01T05:14:55.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3572024-08-01T05:14:56.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3582024-08-01T05:14:56.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3592024-08-01T05:14:56.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3602024-08-01T05:14:56.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3612024-08-01T05:14:57.435ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3622024-08-01T05:14:57.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3632024-08-01T05:14:57.595ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:59955 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 67dd4f1f-c652-4865-960b-b463df992960
3642024-08-01T05:14:57.598ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:59955 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 67dd4f1f-c652-4865-960b-b463df992960
3652024-08-01T05:14:57.598ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics address = [fd00:1122:3344:101::1]:59955 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 67dd4f1f-c652-4865-960b-b463df992960
3662024-08-01T05:14:57.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3672024-08-01T05:14:57.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3682024-08-01T05:14:58.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3692024-08-01T05:14:58.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3702024-08-01T05:14:58.537ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
3712024-08-01T05:14:58.541ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
3722024-08-01T05:14:58.541ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics address = [fd00:1122:3344:101::b]:34072 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 1d5954f0-b510-4a4f-be37-9b6e9a43e8d1
3732024-08-01T05:14:58.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3742024-08-01T05:14:58.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3752024-08-01T05:14:59.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3762024-08-01T05:14:59.435ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3772024-08-01T05:14:59.947ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3782024-08-01T05:14:59.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3792024-08-01T05:15:00.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3802024-08-01T05:15:00.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3812024-08-01T05:15:00.449ZDEBGoximeter (results-sink): inserting 209 samples into database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d
3822024-08-01T05:15:00.449ZDEBGoximeter (clickhouse-client): unrolling 209 total samples collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3832024-08-01T05:15:00.453ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3842024-08-01T05:15:00.459ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 schema = {"timeseries_name":"oximeter_collector:collections","fields.name":["base_route","collector_id","collector_ip","collector_port","producer_id","producer_ip","producer_port"],"fields.type":["String","Uuid","IpAddr","U16","Uuid","IpAddr","U16"],"fields.source":["Metric","Target","Target","Target","Metric","Metric","Metric"],"datum_type":"CumulativeU64","created":"2024-08-01 05:15:00.453530097"} timeseries_name = oximeter_collector:collections
3852024-08-01T05:15:00.464ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0
3862024-08-01T05:15:00.468ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 21 table_name = oximeter.fields_i64
3872024-08-01T05:15:00.474ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 4 table_name = oximeter.fields_ipaddr
3882024-08-01T05:15:00.476ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 131 table_name = oximeter.fields_string
3892024-08-01T05:15:00.481ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 4 table_name = oximeter.fields_u16
3902024-08-01T05:15:00.483ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 85 table_name = oximeter.fields_uuid
3912024-08-01T05:15:00.489ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 148 table_name = oximeter.measurements_cumulativeu64
3922024-08-01T05:15:00.494ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 21 table_name = oximeter.measurements_histogramf64
3932024-08-01T05:15:00.499ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d id = 1655834f-36c9-4345-b563-0045286753f0 n_rows = 40 table_name = oximeter.measurements_u64
3942024-08-01T05:15:00.948ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3952024-08-01T05:15:00.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3962024-08-01T05:15:01.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3972024-08-01T05:15:01.437ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
3982024-08-01T05:15:01.948ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
3992024-08-01T05:15:01.948ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7166ff7f-62a4-4472-af77-2fee85293603
4002024-08-01T05:15:02.434ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2
4012024-08-01T05:15:02.436ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::1]:8001 collector_id = 92f84514-0948-4db1-a30c-ef7b7d8b090c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 64001ea1-835b-42b1-b217-3ed98ed250e2