Max level shown:
1 [ May 14 04:13:09 Enabled. ]
2 [ May 14 04:13:09 Rereading configuration. ]
3 [ May 14 04:13:10 Rereading configuration. ]
4 [ May 14 04:13:12 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 90873ca0-52f3-4dd5-a08c-9897fa8723c5 &"). ]
5 [ May 14 04:13:12 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-05-14T04:13:12.761ZDEBGoximeter: registered DTrace probes
82024-05-14T04:13:12.762ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:194
92024-05-14T04:13:12.763ZINFOoximeter (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
102024-05-14T04:13:12.766ZDEBGoximeter: creating ClickHouse client
112024-05-14T04:13:12.767ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
122024-05-14T04:13:12.871ZWARNoximeter (clickhouse-client): failed to read version collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:683 id = ef68b3f7-f98d-48ea-a5e2-73a8001cc9cf
132024-05-14T04:13:12.875ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 248.595304ms
142024-05-14T04:13:13.121ZDEBGoximeter: creating ClickHouse client
152024-05-14T04:13:13.121ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
162024-05-14T04:13:13.162ZWARNoximeter (clickhouse-client): failed to read version collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:683 id = 0e05a660-228f-43bf-bc43-0670ede465dc
172024-05-14T04:13:13.163ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 655.138415ms
182024-05-14T04:13:13.819ZDEBGoximeter: creating ClickHouse client
192024-05-14T04:13:13.819ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
202024-05-14T04:13:13.851ZWARNoximeter (clickhouse-client): failed to read version collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d error = Telemetry database unavailable: error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146) file = oximeter/db/src/client/mod.rs:683 id = e33cb9f4-e8b8-49de-9ddd-72f506dfad08
212024-05-14T04:13:13.852ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseUnavailable("error sending request for url (http://[fd00:1122:3344:101::e]:8123/?output_format_json_quote_64bit_integers=0&wait_end_of_query=1): error trying to connect: tcp connect error: Connection refused (os error 146)")) file = oximeter/collector/src/lib.rs:216 retry_after = 647.154287ms
222024-05-14T04:13:14.500ZDEBGoximeter: creating ClickHouse client
232024-05-14T04:13:14.500ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
242024-05-14T04:13:14.922ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:679 id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
252024-05-14T04:13:14.922ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
262024-05-14T04:13:14.941ZINFOoximeter (clickhouse-client): reading db version collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:617 id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
272024-05-14T04:13:14.942ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:679 id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
282024-05-14T04:13:14.942ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:621 id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b version = 0
292024-05-14T04:13:14.942ZINFOoximeter (clickhouse-client): wiping and re-initializing oximeter schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:626 id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
302024-05-14T04:13:14.942ZDEBGoximeter (clickhouse-client): wiping ClickHouse database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
312024-05-14T04:13:14.942ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
322024-05-14T04:13:15.109ZINFOoximeter (clickhouse-client): inserting current version collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:649 id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b version = 4
332024-05-14T04:13:15.133ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info
342024-05-14T04:13:15.133ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers
352024-05-14T04:13:15.133ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = POST path = /producers
362024-05-14T04:13:15.133ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id}
372024-05-14T04:13:15.133ZINFOoximeter (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::d]:12223
382024-05-14T04:13:15.133ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
392024-05-14T04:13:15.133ZDEBGoximeter: contacting nexus
402024-05-14T04:13:15.133ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
412024-05-14T04:13:15.173ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
422024-05-14T04:13:15.173ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
432024-05-14T04:13:15.173ZWARNoximeter: failed to contact nexus, will retry in 349.874684ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
442024-05-14T04:13:15.525ZDEBGoximeter: contacting nexus
452024-05-14T04:13:15.525ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
462024-05-14T04:13:15.555ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
472024-05-14T04:13:15.555ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
482024-05-14T04:13:15.555ZWARNoximeter: failed to contact nexus, will retry in 501.357304ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
492024-05-14T04:13:16.057ZDEBGoximeter: contacting nexus
502024-05-14T04:13:16.057ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
512024-05-14T04:13:16.087ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
522024-05-14T04:13:16.087ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
532024-05-14T04:13:16.087ZWARNoximeter: failed to contact nexus, will retry in 1.065908734s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
542024-05-14T04:13:17.154ZDEBGoximeter: contacting nexus
552024-05-14T04:13:17.154ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
562024-05-14T04:13:17.184ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
572024-05-14T04:13:17.184ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
582024-05-14T04:13:17.185ZWARNoximeter: failed to contact nexus, will retry in 1.652420301s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
592024-05-14T04:13:18.838ZDEBGoximeter: contacting nexus
602024-05-14T04:13:18.838ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
612024-05-14T04:13:18.868ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
622024-05-14T04:13:18.868ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
632024-05-14T04:13:18.868ZWARNoximeter: failed to contact nexus, will retry in 4.346694025s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
642024-05-14T04:13:23.216ZDEBGoximeter: contacting nexus
652024-05-14T04:13:23.216ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
662024-05-14T04:13:23.247ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
672024-05-14T04:13:23.247ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
682024-05-14T04:13:23.248ZWARNoximeter: failed to contact nexus, will retry in 5.40795551s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:284
692024-05-14T04:13:28.657ZDEBGoximeter: contacting nexus
702024-05-14T04:13:28.657ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
712024-05-14T04:13:28.689ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
722024-05-14T04:13:28.696ZDEBGoximeter: client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e808b458-423d-48f1-a6b4-af2f7bccdb26", "date": "Tue, 14 May 2024 04:13:28 GMT"} })
732024-05-14T04:13:28.697ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:302 id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5
742024-05-14T04:13:28.698ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:767
752024-05-14T04:13:28.702ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
762024-05-14T04:13:28.743ZDEBGoximeter (oximeter-agent): client request body = None collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90873ca0-52f3-4dd5-a08c-9897fa8723c5/producers?sort_by=id_ascending
772024-05-14T04:13:28.746ZDEBGoximeter (oximeter-agent): client response collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/collectors/90873ca0-52f3-4dd5-a08c-9897fa8723c5/producers", query: Some("sort_by=id_ascending"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c3107428-f640-4305-a2da-4eae747438b8", "content-length": "29", "date": "Tue, 14 May 2024 04:13:28 GMT"} })
782024-05-14T04:13:28.749ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:817 n_current_tasks = 0 n_pruned_tasks = 0
792024-05-14T04:13:30.987ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::a]:37851
802024-05-14T04:13:30.990ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59
812024-05-14T04:13:30.990ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 2295 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::a]:37851 req_id = dba2d470-82e2-45c1-a4a5-e116618dba1a response_code = 204 uri = /producers
822024-05-14T04:13:31.023ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
832024-05-14T04:13:41.022ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
842024-05-14T04:13:41.033ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
852024-05-14T04:13:45.122ZDEBGoximeter (results-sink): inserting 38 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
862024-05-14T04:13:45.122ZDEBGoximeter (clickhouse-client): unrolling 38 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
872024-05-14T04:13:45.135ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
882024-05-14T04:13:45.148ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"http_service:request_latency_histogram","fields.name":["id","method","name","route","status_code"],"fields.type":["Uuid","String","String","String","I64"],"fields.source":["Target","Metric","Target","Metric","Metric"],"datum_type":"HistogramF64","created":"2024-05-14 04:13:45.135735292"} timeseries_name = http_service:request_latency_histogram
892024-05-14T04:13:45.158ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
902024-05-14T04:13:45.176ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"collection_target:cpus_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-05-14 04:13:45.158571657"} timeseries_name = collection_target:cpus_provisioned
912024-05-14T04:13:45.178ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
922024-05-14T04:13:45.182ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"collection_target:ram_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-05-14 04:13:45.178405561"} timeseries_name = collection_target:ram_provisioned
932024-05-14T04:13:45.182ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
942024-05-14T04:13:45.184ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"collection_target:virtual_disk_space_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2024-05-14 04:13:45.182435193"} timeseries_name = collection_target:virtual_disk_space_provisioned
952024-05-14T04:13:45.184ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
962024-05-14T04:13:45.210ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 20 table_name = oximeter.fields_i64
972024-05-14T04:13:45.214ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 60 table_name = oximeter.fields_string
982024-05-14T04:13:45.222ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 30 table_name = oximeter.fields_uuid
992024-05-14T04:13:45.229ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 20 table_name = oximeter.measurements_histogramf64
1002024-05-14T04:13:45.232ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 18 table_name = oximeter.measurements_i64
1012024-05-14T04:13:51.021ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1022024-05-14T04:13:51.023ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1032024-05-14T04:13:55.121ZDEBGoximeter (results-sink): inserting 21 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
1042024-05-14T04:13:55.121ZDEBGoximeter (clickhouse-client): unrolling 21 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1052024-05-14T04:13:55.125ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 21 table_name = oximeter.fields_i64
1062024-05-14T04:13:55.127ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 63 table_name = oximeter.fields_string
1072024-05-14T04:13:55.129ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 21 table_name = oximeter.fields_uuid
1082024-05-14T04:13:55.131ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 21 table_name = oximeter.measurements_histogramf64
1092024-05-14T04:14:01.021ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1102024-05-14T04:14:01.023ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1112024-05-14T04:14:05.121ZDEBGoximeter (results-sink): inserting 22 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
1122024-05-14T04:14:05.121ZDEBGoximeter (clickhouse-client): unrolling 22 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1132024-05-14T04:14:05.125ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_i64
1142024-05-14T04:14:05.127ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 66 table_name = oximeter.fields_string
1152024-05-14T04:14:05.129ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_uuid
1162024-05-14T04:14:05.131ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.measurements_histogramf64
1172024-05-14T04:14:11.022ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1182024-05-14T04:14:11.023ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1192024-05-14T04:14:15.122ZDEBGoximeter (results-sink): inserting 22 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
1202024-05-14T04:14:15.122ZDEBGoximeter (clickhouse-client): unrolling 22 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1212024-05-14T04:14:15.126ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_i64
1222024-05-14T04:14:15.128ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 66 table_name = oximeter.fields_string
1232024-05-14T04:14:15.130ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_uuid
1242024-05-14T04:14:15.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.measurements_histogramf64
1252024-05-14T04:14:21.022ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1262024-05-14T04:14:21.024ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1272024-05-14T04:14:25.106ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:49683
1282024-05-14T04:14:25.106ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:44637 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = d4fac703-f5ba-4b34-aac1-7fc066e8abb3
1292024-05-14T04:14:25.106ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:49683 req_id = 6d4f8b86-aea2-4528-90ec-c03beb6407dc response_code = 204 uri = /producers
1302024-05-14T04:14:25.122ZDEBGoximeter (results-sink): inserting 22 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
1312024-05-14T04:14:25.122ZDEBGoximeter (clickhouse-client): unrolling 22 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1322024-05-14T04:14:25.126ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_i64
1332024-05-14T04:14:25.128ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 66 table_name = oximeter.fields_string
1342024-05-14T04:14:25.130ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_uuid
1352024-05-14T04:14:25.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.measurements_histogramf64
1362024-05-14T04:14:25.139ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::b]:44637 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = d4fac703-f5ba-4b34-aac1-7fc066e8abb3 route = //d4fac703-f5ba-4b34-aac1-7fc066e8abb3
1372024-05-14T04:14:25.294ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:60233
1382024-05-14T04:14:25.295ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:55243 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = ef1c9f55-f835-41e6-8d3a-81e26da276c7
1392024-05-14T04:14:25.295ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 719 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:60233 req_id = b9116317-7625-4e34-b546-68b40a950752 response_code = 204 uri = /producers
1402024-05-14T04:14:25.330ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::c]:55243 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = ef1c9f55-f835-41e6-8d3a-81e26da276c7 route = //ef1c9f55-f835-41e6-8d3a-81e26da276c7
1412024-05-14T04:14:31.022ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1422024-05-14T04:14:31.024ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1432024-05-14T04:14:31.024ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1442024-05-14T04:14:33.742ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::a]:56885
1452024-05-14T04:14:33.742ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad
1462024-05-14T04:14:33.742ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 76 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::a]:56885 req_id = bb1e80d4-1734-4f29-b8a2-44c5ee708c94 response_code = 204 uri = /producers
1472024-05-14T04:14:33.774ZDEBGoximeter (collection-task): starting oximeter collection task address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d interval = 1s producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1482024-05-14T04:14:34.773ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1492024-05-14T04:14:34.785ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1502024-05-14T04:14:35.122ZDEBGoximeter (results-sink): inserting 27 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
1512024-05-14T04:14:35.122ZDEBGoximeter (clickhouse-client): unrolling 27 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1522024-05-14T04:14:35.123ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1532024-05-14T04:14:35.140ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:44637 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = d4fac703-f5ba-4b34-aac1-7fc066e8abb3 route = //d4fac703-f5ba-4b34-aac1-7fc066e8abb3
1542024-05-14T04:14:35.153ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:44637 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d4fac703-f5ba-4b34-aac1-7fc066e8abb3 route = //d4fac703-f5ba-4b34-aac1-7fc066e8abb3
1552024-05-14T04:14:35.177ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"oximeter_collector:collections","fields.name":["base_route","collector_id","collector_ip","collector_port","producer_id","producer_ip","producer_port"],"fields.type":["String","Uuid","IpAddr","U16","Uuid","IpAddr","U16"],"fields.source":["Metric","Target","Target","Target","Metric","Metric","Metric"],"datum_type":"CumulativeU64","created":"2024-05-14 04:14:35.123495343"} timeseries_name = oximeter_collector:collections
1562024-05-14T04:14:35.177ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1572024-05-14T04:14:35.180ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"static_routing_config:static_routes","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-05-14 04:14:35.177784549"} timeseries_name = static_routing_config:static_routes
1582024-05-14T04:14:35.180ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1592024-05-14T04:14:35.182ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"static_routing_config:static_nexthops","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"CumulativeU64","created":"2024-05-14 04:14:35.180275130"} timeseries_name = static_routing_config:static_nexthops
1602024-05-14T04:14:35.182ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1612024-05-14T04:14:35.184ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"switch_rib:active_routes","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"U64","created":"2024-05-14 04:14:35.182631508"} timeseries_name = switch_rib:active_routes
1622024-05-14T04:14:35.185ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1632024-05-14T04:14:35.187ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b schema = {"timeseries_name":"mg_lower:routes_blocked_by_link_state","fields.name":["hostname","rack_id","sled_id"],"fields.type":["String","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"U64","created":"2024-05-14 04:14:35.185031927"} timeseries_name = mg_lower:routes_blocked_by_link_state
1642024-05-14T04:14:35.187ZDEBGoximeter (clickhouse-client): inserting 5 new timeseries schema collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1652024-05-14T04:14:35.191ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_i64
1662024-05-14T04:14:35.193ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 2 table_name = oximeter.fields_ipaddr
1672024-05-14T04:14:35.196ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 71 table_name = oximeter.fields_string
1682024-05-14T04:14:35.208ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 2 table_name = oximeter.fields_u16
1692024-05-14T04:14:35.212ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 32 table_name = oximeter.fields_uuid
1702024-05-14T04:14:35.218ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 3 table_name = oximeter.measurements_cumulativeu64
1712024-05-14T04:14:35.221ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.measurements_histogramf64
1722024-05-14T04:14:35.225ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 2 table_name = oximeter.measurements_u64
1732024-05-14T04:14:35.330ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::c]:55243 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = ef1c9f55-f835-41e6-8d3a-81e26da276c7 route = //ef1c9f55-f835-41e6-8d3a-81e26da276c7
1742024-05-14T04:14:35.345ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::c]:55243 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef1c9f55-f835-41e6-8d3a-81e26da276c7 route = //ef1c9f55-f835-41e6-8d3a-81e26da276c7
1752024-05-14T04:14:35.773ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1762024-05-14T04:14:35.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1772024-05-14T04:14:36.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1782024-05-14T04:14:36.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1792024-05-14T04:14:37.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1802024-05-14T04:14:37.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1812024-05-14T04:14:38.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1822024-05-14T04:14:38.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1832024-05-14T04:14:39.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1842024-05-14T04:14:39.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1852024-05-14T04:14:40.122ZDEBGoximeter (results-sink): inserting 36 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
1862024-05-14T04:14:40.122ZDEBGoximeter (clickhouse-client): unrolling 36 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
1872024-05-14T04:14:40.126ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 7 table_name = oximeter.fields_i64
1882024-05-14T04:14:40.128ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 25 table_name = oximeter.fields_string
1892024-05-14T04:14:40.130ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 24 table_name = oximeter.fields_uuid
1902024-05-14T04:14:40.132ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_cumulativeu64
1912024-05-14T04:14:40.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 7 table_name = oximeter.measurements_histogramf64
1922024-05-14T04:14:40.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 9 table_name = oximeter.measurements_i64
1932024-05-14T04:14:40.138ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_u64
1942024-05-14T04:14:40.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1952024-05-14T04:14:40.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1962024-05-14T04:14:41.022ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1972024-05-14T04:14:41.024ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
1982024-05-14T04:14:41.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
1992024-05-14T04:14:41.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2002024-05-14T04:14:42.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2012024-05-14T04:14:42.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2022024-05-14T04:14:43.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2032024-05-14T04:14:43.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2042024-05-14T04:14:44.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2052024-05-14T04:14:44.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2062024-05-14T04:14:45.122ZDEBGoximeter (results-sink): inserting 42 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
2072024-05-14T04:14:45.122ZDEBGoximeter (clickhouse-client): unrolling 42 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
2082024-05-14T04:14:45.127ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_i64
2092024-05-14T04:14:45.129ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 70 table_name = oximeter.fields_string
2102024-05-14T04:14:45.131ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 30 table_name = oximeter.fields_uuid
2112024-05-14T04:14:45.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_cumulativeu64
2122024-05-14T04:14:45.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.measurements_histogramf64
2132024-05-14T04:14:45.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_u64
2142024-05-14T04:14:45.140ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:44637 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = d4fac703-f5ba-4b34-aac1-7fc066e8abb3 route = //d4fac703-f5ba-4b34-aac1-7fc066e8abb3
2152024-05-14T04:14:45.140ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:44637 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d4fac703-f5ba-4b34-aac1-7fc066e8abb3 route = //d4fac703-f5ba-4b34-aac1-7fc066e8abb3
2162024-05-14T04:14:45.330ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::c]:55243 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = ef1c9f55-f835-41e6-8d3a-81e26da276c7 route = //ef1c9f55-f835-41e6-8d3a-81e26da276c7
2172024-05-14T04:14:45.331ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::c]:55243 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef1c9f55-f835-41e6-8d3a-81e26da276c7 route = //ef1c9f55-f835-41e6-8d3a-81e26da276c7
2182024-05-14T04:14:45.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2192024-05-14T04:14:45.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2202024-05-14T04:14:46.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2212024-05-14T04:14:46.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2222024-05-14T04:14:47.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2232024-05-14T04:14:47.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2242024-05-14T04:14:48.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2252024-05-14T04:14:48.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2262024-05-14T04:14:49.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2272024-05-14T04:14:49.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2282024-05-14T04:14:50.122ZDEBGoximeter (results-sink): inserting 27 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
2292024-05-14T04:14:50.122ZDEBGoximeter (clickhouse-client): unrolling 27 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
2302024-05-14T04:14:50.126ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 7 table_name = oximeter.fields_i64
2312024-05-14T04:14:50.128ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 25 table_name = oximeter.fields_string
2322024-05-14T04:14:50.130ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 15 table_name = oximeter.fields_uuid
2332024-05-14T04:14:50.132ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_cumulativeu64
2342024-05-14T04:14:50.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 7 table_name = oximeter.measurements_histogramf64
2352024-05-14T04:14:50.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_u64
2362024-05-14T04:14:50.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2372024-05-14T04:14:50.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2382024-05-14T04:14:51.022ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
2392024-05-14T04:14:51.025ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
2402024-05-14T04:14:51.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2412024-05-14T04:14:51.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2422024-05-14T04:14:52.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2432024-05-14T04:14:52.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2442024-05-14T04:14:53.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2452024-05-14T04:14:53.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2462024-05-14T04:14:54.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2472024-05-14T04:14:54.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2482024-05-14T04:14:55.122ZDEBGoximeter (results-sink): inserting 42 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
2492024-05-14T04:14:55.122ZDEBGoximeter (clickhouse-client): unrolling 42 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
2502024-05-14T04:14:55.127ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.fields_i64
2512024-05-14T04:14:55.129ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 70 table_name = oximeter.fields_string
2522024-05-14T04:14:55.131ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 30 table_name = oximeter.fields_uuid
2532024-05-14T04:14:55.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_cumulativeu64
2542024-05-14T04:14:55.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 22 table_name = oximeter.measurements_histogramf64
2552024-05-14T04:14:55.138ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_u64
2562024-05-14T04:14:55.140ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::b]:44637 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = d4fac703-f5ba-4b34-aac1-7fc066e8abb3 route = //d4fac703-f5ba-4b34-aac1-7fc066e8abb3
2572024-05-14T04:14:55.140ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::b]:44637 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d4fac703-f5ba-4b34-aac1-7fc066e8abb3 route = //d4fac703-f5ba-4b34-aac1-7fc066e8abb3
2582024-05-14T04:14:55.330ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::c]:55243 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = ef1c9f55-f835-41e6-8d3a-81e26da276c7 route = //ef1c9f55-f835-41e6-8d3a-81e26da276c7
2592024-05-14T04:14:55.331ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::c]:55243 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef1c9f55-f835-41e6-8d3a-81e26da276c7 route = //ef1c9f55-f835-41e6-8d3a-81e26da276c7
2602024-05-14T04:14:55.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2612024-05-14T04:14:55.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2622024-05-14T04:14:56.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2632024-05-14T04:14:56.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2642024-05-14T04:14:57.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2652024-05-14T04:14:57.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2662024-05-14T04:14:58.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2672024-05-14T04:14:58.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2682024-05-14T04:14:59.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2692024-05-14T04:14:59.775ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2702024-05-14T04:15:00.122ZDEBGoximeter (results-sink): inserting 27 samples into database collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d
2712024-05-14T04:15:00.122ZDEBGoximeter (clickhouse-client): unrolling 27 total samples collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b
2722024-05-14T04:15:00.127ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 7 table_name = oximeter.fields_i64
2732024-05-14T04:15:00.131ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 25 table_name = oximeter.fields_string
2742024-05-14T04:15:00.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 15 table_name = oximeter.fields_uuid
2752024-05-14T04:15:00.143ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_cumulativeu64
2762024-05-14T04:15:00.149ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 7 table_name = oximeter.measurements_histogramf64
2772024-05-14T04:15:00.156ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d id = 173fd978-dfe5-4aaa-8f44-662aefb7b98b n_rows = 10 table_name = oximeter.measurements_u64
2782024-05-14T04:15:00.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2792024-05-14T04:15:00.774ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2802024-05-14T04:15:01.023ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
2812024-05-14T04:15:01.024ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::a]:46751 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 4db81567-f1e3-4377-871b-92d735132e59 route = //4db81567-f1e3-4377-871b-92d735132e59
2822024-05-14T04:15:01.774ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad
2832024-05-14T04:15:01.776ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90873ca0-52f3-4dd5-a08c-9897fa8723c5 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 751546b3-1c48-433c-ac6c-ece0271284ad route = //751546b3-1c48-433c-ac6c-ece0271284ad