Max level shown:
1 [ Nov 2 05:42:57 Disabled. ]
2 [ Nov 2 05:42:57 Rereading configuration. ]
3 [ Nov 2 05:43:14 Rereading configuration. ]
4 [ Nov 2 05:43:14 Rereading configuration. ]
5 [ Nov 2 05:43:14 Enabled. ]
6 [ Nov 2 05:43:14 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id c57a3af8-27c8-4d02-a526-6d4179390511 &"). ]
7 [ Nov 2 05:43:14 Method "start" exited with status 0. ]
8 note: configured to log to "/dev/stdout"
92023-11-02T05:43:14.858ZDEBGoximeter: registered DTrace probes
102023-11-02T05:43:14.859ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:729
112023-11-02T05:43:14.860ZINFOoximeter (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
122023-11-02T05:43:14.860ZDEBGoximeter: creating ClickHouse client
132023-11-02T05:43:14.860ZDEBGoximeter (DnsResolver): lookup srv dns_name = _clickhouse._tcp.control-plane.oxide.internal
142023-11-02T05:43:14.953ZINFOoximeter (clickhouse-client): reading db version collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 file = oximeter/db/src/client.rs:284 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
152023-11-02T05:43:14.976ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 file = oximeter/db/src/client.rs:346 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
162023-11-02T05:43:14.976ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 file = oximeter/db/src/client.rs:288 id = 47c0be61-7393-4c87-b012-aa2c38622e8f version = 0
172023-11-02T05:43:14.976ZINFOoximeter (clickhouse-client): wiping and re-initializing oximeter schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 file = oximeter/db/src/client.rs:293 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
182023-11-02T05:43:14.976ZDEBGoximeter (clickhouse-client): wiping ClickHouse database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
192023-11-02T05:43:14.976ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
202023-11-02T05:43:15.194ZINFOoximeter (clickhouse-client): inserting current version collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 file = oximeter/db/src/client.rs:317 id = 47c0be61-7393-4c87-b012-aa2c38622e8f version = 2
212023-11-02T05:43:15.206ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info
222023-11-02T05:43:15.206ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers
232023-11-02T05:43:15.206ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = POST path = /producers
242023-11-02T05:43:15.206ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id}
252023-11-02T05:43:15.206ZINFOoximeter (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:195 local_addr = [fd00:1122:3344:101::d]:12223
262023-11-02T05:43:15.206ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
272023-11-02T05:43:15.238ZDEBGoximeter: contacting nexus
282023-11-02T05:43:15.238ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
292023-11-02T05:43:15.240ZWARNoximeter: failed to contact nexus, will retry in 183.976275ms error = "error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:801
302023-11-02T05:43:15.424ZDEBGoximeter: contacting nexus
312023-11-02T05:43:15.424ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
322023-11-02T05:43:15.425ZWARNoximeter: failed to contact nexus, will retry in 432.427294ms error = "error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:801
332023-11-02T05:43:15.857ZDEBGoximeter: contacting nexus
342023-11-02T05:43:15.857ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
352023-11-02T05:43:15.858ZWARNoximeter: failed to contact nexus, will retry in 720.296651ms error = "error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:801
362023-11-02T05:43:16.578ZDEBGoximeter: contacting nexus
372023-11-02T05:43:16.578ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
382023-11-02T05:43:16.579ZWARNoximeter: failed to contact nexus, will retry in 1.39799265s error = "error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:801
392023-11-02T05:43:17.973ZDEBGoximeter: contacting nexus
402023-11-02T05:43:17.973ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
412023-11-02T05:43:17.974ZWARNoximeter: failed to contact nexus, will retry in 2.920214583s error = "error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:801
422023-11-02T05:43:20.887ZDEBGoximeter: contacting nexus
432023-11-02T05:43:20.887ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
442023-11-02T05:43:20.888ZWARNoximeter: failed to contact nexus, will retry in 8.792223577s error = "error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:801
452023-11-02T05:43:29.657ZDEBGoximeter: contacting nexus
462023-11-02T05:43:29.657ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
472023-11-02T05:43:29.658ZWARNoximeter: failed to contact nexus, will retry in 13.336392353s error = "error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/collector/src/lib.rs:801
482023-11-02T05:43:42.967ZDEBGoximeter: contacting nexus
492023-11-02T05:43:42.967ZDEBGoximeter (DnsResolver): lookup_ipv6 srv dns_name = _nexus._tcp.control-plane.oxide.internal
502023-11-02T05:43:42.978ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:815 id = c57a3af8-27c8-4d02-a526-6d4179390511
512023-11-02T05:43:43.927ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:65265
522023-11-02T05:43:43.929ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:12224 collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
532023-11-02T05:43:43.929ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:853 latency_us = 2473 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:65265 req_id = 11e66e19-4485-440b-afcf-3c595ad3c547 response_code = 204 uri = /producers
542023-11-02T05:43:43.963ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 interval = 10s producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
552023-11-02T05:43:53.964ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
562023-11-02T05:43:53.968ZDEBGoximeter (collection-task): collected 1 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
572023-11-02T05:43:55.136ZDEBGoximeter (results-sink): inserting 97 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
582023-11-02T05:43:55.136ZDEBGoximeter (clickhouse-client): unrolling 97 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
592023-11-02T05:43:55.148ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
602023-11-02T05:43:55.151ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"data_link:enabled","fields.name":["link_id","port_id","rack_id","sidecar_id","sled_id"],"fields.type":["I64","String","Uuid","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"Bool","created":"2023-11-02 05:43:55.136644654"} timeseries_name = data_link:enabled
612023-11-02T05:43:55.153ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
622023-11-02T05:43:55.164ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"data_link:link_up","fields.name":["link_id","port_id","rack_id","sidecar_id","sled_id"],"fields.type":["I64","String","Uuid","Uuid","Uuid"],"fields.source":["Target","Target","Target","Target","Target"],"datum_type":"Bool","created":"2023-11-02 05:43:55.153500402"} timeseries_name = data_link:link_up
632023-11-02T05:43:55.164ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
642023-11-02T05:43:55.169ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:capacity","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"I64","created":"2023-11-02 05:43:55.164898654"} timeseries_name = switch_table:capacity
652023-11-02T05:43:55.169ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
662023-11-02T05:43:55.171ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:occupancy","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"I64","created":"2023-11-02 05:43:55.169055494"} timeseries_name = switch_table:occupancy
672023-11-02T05:43:55.171ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
682023-11-02T05:43:55.173ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:inserts","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:43:55.171200011"} timeseries_name = switch_table:inserts
692023-11-02T05:43:55.173ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
702023-11-02T05:43:55.175ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:deletes","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:43:55.173364009"} timeseries_name = switch_table:deletes
712023-11-02T05:43:55.175ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
722023-11-02T05:43:55.177ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:updates","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:43:55.175440804"} timeseries_name = switch_table:updates
732023-11-02T05:43:55.177ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
742023-11-02T05:43:55.179ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:collisions","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:43:55.177575520"} timeseries_name = switch_table:collisions
752023-11-02T05:43:55.179ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
762023-11-02T05:43:55.181ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:update_misses","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:43:55.179692506"} timeseries_name = switch_table:update_misses
772023-11-02T05:43:55.181ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
782023-11-02T05:43:55.183ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:delete_misses","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:43:55.181637678"} timeseries_name = switch_table:delete_misses
792023-11-02T05:43:55.183ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
802023-11-02T05:43:55.185ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"switch_table:exhaustion","fields.name":["rack_id","sidecar_id","sled_id","table"],"fields.type":["Uuid","Uuid","Uuid","String"],"fields.source":["Target","Target","Target","Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:43:55.183468507"} timeseries_name = switch_table:exhaustion
812023-11-02T05:43:55.190ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
822023-11-02T05:43:55.192ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"sidecar:sample_time","fields.name":["rack_id","sidecar_id","sled_id"],"fields.type":["Uuid","Uuid","Uuid"],"fields.source":["Target","Target","Target"],"datum_type":"I64","created":"2023-11-02 05:43:55.190062952"} timeseries_name = sidecar:sample_time
832023-11-02T05:43:55.192ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
842023-11-02T05:43:55.200ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.fields_i64
852023-11-02T05:43:55.202ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 96 table_name = oximeter.fields_string
862023-11-02T05:43:55.207ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 291 table_name = oximeter.fields_uuid
872023-11-02T05:43:55.209ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.measurements_bool
882023-11-02T05:43:55.211ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 70 table_name = oximeter.measurements_cumulativei64
892023-11-02T05:43:55.213ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 21 table_name = oximeter.measurements_i64
902023-11-02T05:43:59.446ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::b]:59419
912023-11-02T05:43:59.446ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:12221 collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
922023-11-02T05:43:59.446ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:853 latency_us = 107 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::b]:59419 req_id = b2e9f52c-ea7c-4f8b-b71a-bec45d1ddbf4 response_code = 204 uri = /producers
932023-11-02T05:43:59.479ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 interval = 10s producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
942023-11-02T05:44:03.964ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
952023-11-02T05:44:03.965ZDEBGoximeter (collection-task): collected 1 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
962023-11-02T05:44:05.137ZDEBGoximeter (results-sink): inserting 97 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
972023-11-02T05:44:05.137ZDEBGoximeter (clickhouse-client): unrolling 97 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
982023-11-02T05:44:05.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.fields_i64
992023-11-02T05:44:05.146ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 96 table_name = oximeter.fields_string
1002023-11-02T05:44:05.148ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 291 table_name = oximeter.fields_uuid
1012023-11-02T05:44:05.149ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.measurements_bool
1022023-11-02T05:44:05.151ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 70 table_name = oximeter.measurements_cumulativei64
1032023-11-02T05:44:05.152ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 21 table_name = oximeter.measurements_i64
1042023-11-02T05:44:09.480ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
1052023-11-02T05:44:09.485ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
1062023-11-02T05:44:10.137ZDEBGoximeter (results-sink): inserting 69 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
1072023-11-02T05:44:10.137ZDEBGoximeter (clickhouse-client): unrolling 69 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1082023-11-02T05:44:10.137ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1092023-11-02T05:44:10.150ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"http_service:request_latency_histogram","fields.name":["id","method","name","route","status_code"],"fields.type":["Uuid","String","String","String","I64"],"fields.source":["Target","Metric","Target","Metric","Metric"],"datum_type":"HistogramF64","created":"2023-11-02 05:44:10.137559129"} timeseries_name = http_service:request_latency_histogram
1102023-11-02T05:44:10.153ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1112023-11-02T05:44:10.155ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"collection_target:cpus_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2023-11-02 05:44:10.152973708"} timeseries_name = collection_target:cpus_provisioned
1122023-11-02T05:44:10.155ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1132023-11-02T05:44:10.158ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"collection_target:ram_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2023-11-02 05:44:10.155638458"} timeseries_name = collection_target:ram_provisioned
1142023-11-02T05:44:10.158ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1152023-11-02T05:44:10.160ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"collection_target:virtual_disk_space_provisioned","fields.name":["id"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"I64","created":"2023-11-02 05:44:10.158281709"} timeseries_name = collection_target:virtual_disk_space_provisioned
1162023-11-02T05:44:10.162ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1172023-11-02T05:44:10.165ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 39 table_name = oximeter.fields_i64
1182023-11-02T05:44:10.166ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 117 table_name = oximeter.fields_string
1192023-11-02T05:44:10.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 57 table_name = oximeter.fields_uuid
1202023-11-02T05:44:10.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 39 table_name = oximeter.measurements_histogramf64
1212023-11-02T05:44:10.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 30 table_name = oximeter.measurements_i64
1222023-11-02T05:44:13.964ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
1232023-11-02T05:44:13.966ZDEBGoximeter (collection-task): collected 1 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
1242023-11-02T05:44:15.137ZDEBGoximeter (results-sink): inserting 97 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
1252023-11-02T05:44:15.137ZDEBGoximeter (clickhouse-client): unrolling 97 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1262023-11-02T05:44:15.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.fields_i64
1272023-11-02T05:44:15.146ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 96 table_name = oximeter.fields_string
1282023-11-02T05:44:15.148ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 291 table_name = oximeter.fields_uuid
1292023-11-02T05:44:15.149ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.measurements_bool
1302023-11-02T05:44:15.151ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 70 table_name = oximeter.measurements_cumulativei64
1312023-11-02T05:44:15.152ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 21 table_name = oximeter.measurements_i64
1322023-11-02T05:44:16.555ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:36381
1332023-11-02T05:44:16.556ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::22]:51762 collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 8e7a7c19-3393-4ece-9cec-e8fbd077c29f
1342023-11-02T05:44:16.556ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:853 latency_us = 109 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:36381 req_id = d995bcb4-d67c-4da7-a1c9-005ae6c8ad13 response_code = 204 uri = /producers
1352023-11-02T05:44:16.590ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 interval = 30s producer_id = 8e7a7c19-3393-4ece-9cec-e8fbd077c29f
1362023-11-02T05:44:19.480ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
1372023-11-02T05:44:19.484ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
1382023-11-02T05:44:20.137ZDEBGoximeter (results-sink): inserting 44 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
1392023-11-02T05:44:20.137ZDEBGoximeter (clickhouse-client): unrolling 44 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1402023-11-02T05:44:20.142ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_i64
1412023-11-02T05:44:20.143ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 132 table_name = oximeter.fields_string
1422023-11-02T05:44:20.145ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_uuid
1432023-11-02T05:44:20.147ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.measurements_histogramf64
1442023-11-02T05:44:23.964ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
1452023-11-02T05:44:23.965ZDEBGoximeter (collection-task): collected 1 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
1462023-11-02T05:44:25.136ZDEBGoximeter (results-sink): inserting 97 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
1472023-11-02T05:44:25.136ZDEBGoximeter (clickhouse-client): unrolling 97 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1482023-11-02T05:44:25.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.fields_i64
1492023-11-02T05:44:25.147ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 96 table_name = oximeter.fields_string
1502023-11-02T05:44:25.150ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 291 table_name = oximeter.fields_uuid
1512023-11-02T05:44:25.153ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.measurements_bool
1522023-11-02T05:44:25.154ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 70 table_name = oximeter.measurements_cumulativei64
1532023-11-02T05:44:25.155ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 21 table_name = oximeter.measurements_i64
1542023-11-02T05:44:29.480ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
1552023-11-02T05:44:29.484ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
1562023-11-02T05:44:30.137ZDEBGoximeter (results-sink): inserting 44 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
1572023-11-02T05:44:30.137ZDEBGoximeter (clickhouse-client): unrolling 44 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1582023-11-02T05:44:30.142ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_i64
1592023-11-02T05:44:30.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 132 table_name = oximeter.fields_string
1602023-11-02T05:44:30.145ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_uuid
1612023-11-02T05:44:30.147ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.measurements_histogramf64
1622023-11-02T05:44:33.401ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::c]:42033
1632023-11-02T05:44:33.401ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:12221 collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 94c0c207-1235-4f87-ae36-89043bc40a88
1642023-11-02T05:44:33.401ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:853 latency_us = 113 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::c]:42033 req_id = 93c72c83-fc09-49eb-9ea9-0198250f748d response_code = 204 uri = /producers
1652023-11-02T05:44:33.434ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 interval = 10s producer_id = 94c0c207-1235-4f87-ae36-89043bc40a88
1662023-11-02T05:44:33.592ZINFOoximeter (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::d]:12223 remote_addr = [fd00:1122:3344:101::a]:61847
1672023-11-02T05:44:33.592ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:12221 collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 55b029ac-878e-49b2-9b82-9d48e005ad6f
1682023-11-02T05:44:33.592ZINFOoximeter (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/fa728d0/dropshot/src/server.rs:853 latency_us = 103 local_addr = [fd00:1122:3344:101::d]:12223 method = POST remote_addr = [fd00:1122:3344:101::a]:61847 req_id = d2c6925c-afd3-4afc-a0dd-35d251e39b36 response_code = 204 uri = /producers
1692023-11-02T05:44:33.626ZDEBGoximeter (collection-task): starting oximeter collection task collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 interval = 10s producer_id = 55b029ac-878e-49b2-9b82-9d48e005ad6f
1702023-11-02T05:44:33.964ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
1712023-11-02T05:44:33.965ZDEBGoximeter (collection-task): collected 1 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
1722023-11-02T05:44:35.137ZDEBGoximeter (results-sink): inserting 97 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
1732023-11-02T05:44:35.137ZDEBGoximeter (clickhouse-client): unrolling 97 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1742023-11-02T05:44:35.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.fields_i64
1752023-11-02T05:44:35.146ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 96 table_name = oximeter.fields_string
1762023-11-02T05:44:35.147ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 291 table_name = oximeter.fields_uuid
1772023-11-02T05:44:35.149ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.measurements_bool
1782023-11-02T05:44:35.151ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 70 table_name = oximeter.measurements_cumulativei64
1792023-11-02T05:44:35.152ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 21 table_name = oximeter.measurements_i64
1802023-11-02T05:44:39.481ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
1812023-11-02T05:44:39.485ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
1822023-11-02T05:44:40.137ZDEBGoximeter (results-sink): inserting 44 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
1832023-11-02T05:44:40.137ZDEBGoximeter (clickhouse-client): unrolling 44 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1842023-11-02T05:44:40.142ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_i64
1852023-11-02T05:44:40.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 132 table_name = oximeter.fields_string
1862023-11-02T05:44:40.145ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_uuid
1872023-11-02T05:44:40.147ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.measurements_histogramf64
1882023-11-02T05:44:43.434ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 94c0c207-1235-4f87-ae36-89043bc40a88
1892023-11-02T05:44:43.435ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 94c0c207-1235-4f87-ae36-89043bc40a88
1902023-11-02T05:44:43.626ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 55b029ac-878e-49b2-9b82-9d48e005ad6f
1912023-11-02T05:44:43.627ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 55b029ac-878e-49b2-9b82-9d48e005ad6f
1922023-11-02T05:44:43.964ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
1932023-11-02T05:44:43.965ZDEBGoximeter (collection-task): collected 1 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
1942023-11-02T05:44:45.138ZDEBGoximeter (results-sink): inserting 103 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
1952023-11-02T05:44:45.138ZDEBGoximeter (clickhouse-client): unrolling 103 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
1962023-11-02T05:44:45.146ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 9 table_name = oximeter.fields_i64
1972023-11-02T05:44:45.147ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 105 table_name = oximeter.fields_string
1982023-11-02T05:44:45.149ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 297 table_name = oximeter.fields_uuid
1992023-11-02T05:44:45.151ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.measurements_bool
2002023-11-02T05:44:45.154ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 70 table_name = oximeter.measurements_cumulativei64
2012023-11-02T05:44:45.156ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 3 table_name = oximeter.measurements_histogramf64
2022023-11-02T05:44:45.158ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 24 table_name = oximeter.measurements_i64
2032023-11-02T05:44:46.590ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 8e7a7c19-3393-4ece-9cec-e8fbd077c29f
2042023-11-02T05:44:46.591ZDEBGoximeter (collection-task): collected 2 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 8e7a7c19-3393-4ece-9cec-e8fbd077c29f
2052023-11-02T05:44:49.480ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
2062023-11-02T05:44:49.484ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
2072023-11-02T05:44:50.137ZDEBGoximeter (results-sink): inserting 55 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
2082023-11-02T05:44:50.137ZDEBGoximeter (clickhouse-client): unrolling 55 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2092023-11-02T05:44:50.137ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2102023-11-02T05:44:50.142ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"instance_uuid:reset","fields.name":["uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.137420656"} timeseries_name = instance_uuid:reset
2112023-11-02T05:44:50.142ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2122023-11-02T05:44:50.145ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:activated","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.142263385"} timeseries_name = crucible_upstairs:activated
2132023-11-02T05:44:50.145ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2142023-11-02T05:44:50.148ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:flush","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.145478200"} timeseries_name = crucible_upstairs:flush
2152023-11-02T05:44:50.148ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2162023-11-02T05:44:50.152ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:write","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.148688375"} timeseries_name = crucible_upstairs:write
2172023-11-02T05:44:50.152ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2182023-11-02T05:44:50.155ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:write_bytes","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.152060174"} timeseries_name = crucible_upstairs:write_bytes
2192023-11-02T05:44:50.155ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2202023-11-02T05:44:50.158ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:read","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.155345602"} timeseries_name = crucible_upstairs:read
2212023-11-02T05:44:50.159ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2222023-11-02T05:44:50.162ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:read_bytes","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.158907196"} timeseries_name = crucible_upstairs:read_bytes
2232023-11-02T05:44:50.162ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2242023-11-02T05:44:50.165ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:flush_close","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.162416309"} timeseries_name = crucible_upstairs:flush_close
2252023-11-02T05:44:50.165ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2262023-11-02T05:44:50.168ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:extent_repair","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.165647945"} timeseries_name = crucible_upstairs:extent_repair
2272023-11-02T05:44:50.168ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2282023-11-02T05:44:50.171ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:extent_no_op","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.168832260"} timeseries_name = crucible_upstairs:extent_no_op
2292023-11-02T05:44:50.171ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2302023-11-02T05:44:50.175ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f schema = {"timeseries_name":"crucible_upstairs:extent_reopen","fields.name":["upstairs_uuid"],"fields.type":["Uuid"],"fields.source":["Target"],"datum_type":"CumulativeI64","created":"2023-11-02 05:44:50.171778658"} timeseries_name = crucible_upstairs:extent_reopen
2312023-11-02T05:44:50.177ZDEBGoximeter (clickhouse-client): inserting 11 new timeseries schema collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2322023-11-02T05:44:50.181ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_i64
2332023-11-02T05:44:50.184ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 132 table_name = oximeter.fields_string
2342023-11-02T05:44:50.188ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 55 table_name = oximeter.fields_uuid
2352023-11-02T05:44:50.191ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 11 table_name = oximeter.measurements_cumulativei64
2362023-11-02T05:44:50.194ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.measurements_histogramf64
2372023-11-02T05:44:53.435ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 94c0c207-1235-4f87-ae36-89043bc40a88
2382023-11-02T05:44:53.435ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 94c0c207-1235-4f87-ae36-89043bc40a88
2392023-11-02T05:44:53.626ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 55b029ac-878e-49b2-9b82-9d48e005ad6f
2402023-11-02T05:44:53.627ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 55b029ac-878e-49b2-9b82-9d48e005ad6f
2412023-11-02T05:44:53.964ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
2422023-11-02T05:44:53.965ZDEBGoximeter (collection-task): collected 1 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 1595217b-bdf1-4144-bef4-cef090a877e2
2432023-11-02T05:44:55.137ZDEBGoximeter (results-sink): inserting 102 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
2442023-11-02T05:44:55.137ZDEBGoximeter (clickhouse-client): unrolling 102 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2452023-11-02T05:44:55.146ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 11 table_name = oximeter.fields_i64
2462023-11-02T05:44:55.147ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 111 table_name = oximeter.fields_string
2472023-11-02T05:44:55.149ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 296 table_name = oximeter.fields_uuid
2482023-11-02T05:44:55.150ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 6 table_name = oximeter.measurements_bool
2492023-11-02T05:44:55.152ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 70 table_name = oximeter.measurements_cumulativei64
2502023-11-02T05:44:55.153ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 5 table_name = oximeter.measurements_histogramf64
2512023-11-02T05:44:55.154ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 21 table_name = oximeter.measurements_i64
2522023-11-02T05:44:59.481ZDEBGoximeter (collection-task): collecting from producer collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
2532023-11-02T05:44:59.484ZDEBGoximeter (collection-task): collected 3 total results collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 producer_id = 263f7591-d1a2-4aca-92cb-a0be7abd5abe
2542023-11-02T05:45:00.137ZDEBGoximeter (results-sink): inserting 44 samples into database collector_id = c57a3af8-27c8-4d02-a526-6d4179390511
2552023-11-02T05:45:00.137ZDEBGoximeter (clickhouse-client): unrolling 44 total samples collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f
2562023-11-02T05:45:00.142ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_i64
2572023-11-02T05:45:00.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 132 table_name = oximeter.fields_string
2582023-11-02T05:45:00.146ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.fields_uuid
2592023-11-02T05:45:00.148ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c57a3af8-27c8-4d02-a526-6d4179390511 id = 47c0be61-7393-4c87-b012-aa2c38622e8f n_rows = 44 table_name = oximeter.measurements_histogramf64