Max level shown:
1 [ Mar 4 05:56:37 Enabled. ]
2 [ Mar 4 05:56:37 Rereading configuration. ]
3 [ Mar 4 05:56:38 Rereading configuration. ]
4 [ Mar 4 05:56:49 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Mar 4 05:56:49 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-03-04T05:56:49.818ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-03-04T05:56:49.897ZINFOtfportd: connected to dpd running softnpu-b37a8fdc-dirty
92025-03-04T05:56:49.898ZINFOtfportd: running in sync-only mode
102025-03-04T05:56:49.905ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-03-04T05:56:49.912ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-03-04T05:56:49.919ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb, ), sled_id: Some( dbce58b0-062a-4b73-bfbe-866ce6aaea71, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142025-03-04T05:56:49.920ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-03-04T05:56:49.925ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
162025-03-04T05:56:49.932ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c04:eaff:fee1:3fb->0e:04:ea:e1:03:fb interface = tfportrear0_0
172025-03-04T05:56:49.932ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::98bd:24ff:fea6:9460->9a:bd:24:a6:94:60 interface = tfportrear0_0
182025-03-04T05:56:49.945ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
192025-03-04T05:56:49.957ZWARNtfportd: tfportqsfp0_0 has no addrs
202025-03-04T05:56:50.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
212025-03-04T05:56:50.516ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
222025-03-04T05:56:50.522ZWARNtfportd: tfportqsfp0_0 has no addrs
23 [ Mar 4 05:56:50 Rereading configuration. ]
24 [ Mar 4 05:56:50 Executing refresh method (:kill). ]
25 [ Mar 4 05:56:50 Stopping because all processes in service exited. ]
26 [ Mar 4 05:56:50 Executing stop method (:kill). ]
27 [ Mar 4 05:56:50 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
28 [ Mar 4 05:56:50 Method "start" exited with status 0. ]
292025-03-04T05:56:50.641ZINFOtfportd: connecting to dpd host = [::1] port = 12224
302025-03-04T05:56:50.681ZINFOtfportd: connected to dpd running softnpu-b37a8fdc-dirty
312025-03-04T05:56:50.681ZINFOtfportd: running in sync-only mode
322025-03-04T05:56:50.681ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
332025-03-04T05:56:50.687ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
342025-03-04T05:56:50.690ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb, sled_id: dbce58b0-062a-4b73-bfbe-866ce6aaea71, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 18822dbd-ebcc-4f7f-a49d-4028ca0a77af, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
352025-03-04T05:56:50.690ZDEBGtfportd: created producer ID producer_id = 10e7a388-4f20-4ec9-94e4-cacb04dd1c65 unit = oximeter
362025-03-04T05:56:50.692ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb, ), sled_id: Some( dbce58b0-062a-4b73-bfbe-866ce6aaea71, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
372025-03-04T05:56:50.698ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c04:eaff:fee1:3fb->0e:04:ea:e1:03:fb interface = tfportrear0_0
382025-03-04T05:56:50.698ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::98bd:24ff:fea6:9460->9a:bd:24:a6:94:60 interface = tfportrear0_0
392025-03-04T05:56:50.699ZDEBGtfportd: registered DTrace probes unit = producer-server
402025-03-04T05:56:50.699ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
412025-03-04T05:56:50.702ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:50142 method = GET path = /{producer_id} unit = producer-server versions = all
422025-03-04T05:56:50.702ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:50142 unit = producer-server
432025-03-04T05:56:50.702ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:50142 unit = producer-server
442025-03-04T05:56:50.702ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:50142 unit = producer-server
452025-03-04T05:56:50.702ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
462025-03-04T05:56:50.702ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/internal-dns/resolver/src/resolver.rs:111 unit = producer-server
472025-03-04T05:56:50.703ZDEBGtfportd: starting producer registration task unit = producer-server
482025-03-04T05:56:50.703ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:50142 file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 10e7a388-4f20-4ec9-94e4-cacb04dd1c65 unit = producer-server
492025-03-04T05:56:50.703ZINFOtfportd: created oximeter producer server unit = oximeter
502025-03-04T05:56:50.703ZDEBGtfportd (producer-registration-task): registering / renewing oximeter producer lease with Nexus unit = producer-server
512025-03-04T05:56:50.711ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
522025-03-04T05:56:50.715ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-03-04T05:56:33.487150373Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
532025-03-04T05:56:50.715ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 3581369307375137540 unit = oximeter
542025-03-04T05:56:50.715ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
552025-03-04T05:56:50.718ZWARNtfportd: tfportqsfp0_0 has no addrs
562025-03-04T05:56:51.591ZINFOtfportd: added new ARP entry entry = 10.151.2.174->aa:10:0d:33:cb:67 interface = tfportqsfp0_0
572025-03-04T05:56:51.598ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
582025-03-04T05:56:51.610ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
592025-03-04T05:56:51.617ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
602025-03-04T05:56:51.618ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-03-04T05:56:33.487016172Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
612025-03-04T05:56:51.618ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 15802405230886637707 unit = oximeter
622025-03-04T05:56:51.618ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
632025-03-04T05:56:52.294ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
642025-03-04T05:56:52.304ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
652025-03-04T05:56:52.309ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
662025-03-04T05:56:53.783ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
672025-03-04T05:56:53.794ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
682025-03-04T05:56:53.800ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
692025-03-04T05:56:54.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
702025-03-04T05:56:54.798ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
712025-03-04T05:56:54.805ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
722025-03-04T05:56:55.419ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
732025-03-04T05:56:55.430ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
742025-03-04T05:56:55.435ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
752025-03-04T05:56:55.706ZWARNtfportd (producer-registration-task): failed to lookup Nexus IP, will retry delay = 209.777681ms error = "no record found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:387 unit = producer-server
762025-03-04T05:56:55.917ZWARNtfportd (producer-registration-task): failed to lookup Nexus IP, will retry delay = 724.204109ms error = "no record found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:387 unit = producer-server
772025-03-04T05:56:56.554ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782025-03-04T05:56:56.563ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
792025-03-04T05:56:56.569ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
802025-03-04T05:56:56.643ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("24f19fe8-afd8-4186-82ba-c991c9622aa1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35d27072-44df-4fd6-866d-d1add136b456.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3fe4ab68-bcba-4043-bde2-b3e8e1f013ba.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("3fe4ab68-bcba-4043-bde2-b3e8e1f013ba.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::c))) }], valid_until: Instant { tv_sec: 922, tv_nsec: 121197156 } }) unit = producer-server
812025-03-04T05:56:56.644ZDEBGtfportd (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221 unit = producer-server
822025-03-04T05:56:56.685ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
832025-03-04T05:56:57.822ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842025-03-04T05:56:57.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
852025-03-04T05:56:57.839ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
862025-03-04T05:56:59.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872025-03-04T05:56:59.200ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
882025-03-04T05:56:59.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
892025-03-04T05:57:00.412ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902025-03-04T05:57:00.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
912025-03-04T05:57:00.427ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
922025-03-04T05:57:00.720ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
932025-03-04T05:57:01.458ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942025-03-04T05:57:01.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
952025-03-04T05:57:01.475ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
962025-03-04T05:57:01.621ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
972025-03-04T05:57:02.767ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982025-03-04T05:57:02.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
992025-03-04T05:57:02.783ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1002025-03-04T05:57:04.256ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012025-03-04T05:57:04.267ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1022025-03-04T05:57:04.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1032025-03-04T05:57:04.974ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042025-03-04T05:57:04.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1052025-03-04T05:57:04.991ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1062025-03-04T05:57:06.348ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072025-03-04T05:57:06.359ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1082025-03-04T05:57:06.364ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1092025-03-04T05:57:07.695ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102025-03-04T05:57:07.705ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1112025-03-04T05:57:07.711ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1122025-03-04T05:57:08.632ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132025-03-04T05:57:08.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1142025-03-04T05:57:08.647ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1152025-03-04T05:57:09.588ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162025-03-04T05:57:09.598ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1172025-03-04T05:57:09.603ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1182025-03-04T05:57:10.579ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
1192025-03-04T05:57:10.855ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1202025-03-04T05:57:10.865ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1212025-03-04T05:57:10.870ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1222025-03-04T05:57:11.480ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
1232025-03-04T05:57:11.542ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1242025-03-04T05:57:11.544ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 258.821138ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
1252025-03-04T05:57:11.833ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1262025-03-04T05:57:12.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272025-03-04T05:57:12.233ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1282025-03-04T05:57:12.238ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1292025-03-04T05:57:13.548ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1302025-03-04T05:57:13.558ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1312025-03-04T05:57:13.563ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1322025-03-04T05:57:14.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1332025-03-04T05:57:14.752ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1342025-03-04T05:57:14.757ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1352025-03-04T05:57:15.917ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1362025-03-04T05:57:15.927ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1372025-03-04T05:57:15.932ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1382025-03-04T05:57:16.986ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1392025-03-04T05:57:17.005ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1402025-03-04T05:57:17.015ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1412025-03-04T05:57:18.160ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1422025-03-04T05:57:18.172ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1432025-03-04T05:57:18.178ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1442025-03-04T05:57:19.584ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1452025-03-04T05:57:19.595ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1462025-03-04T05:57:19.601ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1472025-03-04T05:57:21.046ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
1482025-03-04T05:57:21.053ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-03-04T05:57:21.257ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1502025-03-04T05:57:21.270ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512025-03-04T05:57:21.486ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
1522025-03-04T05:57:22.515ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532025-03-04T05:57:22.532ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1542025-03-04T05:57:22.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1552025-03-04T05:57:23.740ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562025-03-04T05:57:23.750ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1572025-03-04T05:57:23.756ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1582025-03-04T05:57:25.061ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592025-03-04T05:57:25.071ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1602025-03-04T05:57:25.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1612025-03-04T05:57:26.060ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1622025-03-04T05:57:26.069ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1632025-03-04T05:57:26.074ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1642025-03-04T05:57:26.839ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1652025-03-04T05:57:26.840ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 306.206342ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
1662025-03-04T05:57:27.007ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672025-03-04T05:57:27.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1682025-03-04T05:57:27.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1692025-03-04T05:57:27.179ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1702025-03-04T05:57:27.821ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712025-03-04T05:57:27.832ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1722025-03-04T05:57:27.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1732025-03-04T05:57:28.838ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742025-03-04T05:57:28.848ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1752025-03-04T05:57:28.853ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1762025-03-04T05:57:29.626ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772025-03-04T05:57:29.637ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1782025-03-04T05:57:29.643ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1792025-03-04T05:57:30.206ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802025-03-04T05:57:30.216ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1812025-03-04T05:57:30.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1822025-03-04T05:57:31.049ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
1832025-03-04T05:57:31.204ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842025-03-04T05:57:31.215ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1852025-03-04T05:57:31.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1862025-03-04T05:57:31.490ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
1872025-03-04T05:57:31.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882025-03-04T05:57:31.799ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1892025-03-04T05:57:31.806ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1902025-03-04T05:57:32.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912025-03-04T05:57:32.604ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1922025-03-04T05:57:32.610ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1932025-03-04T05:57:33.706ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942025-03-04T05:57:33.718ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1952025-03-04T05:57:33.723ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1962025-03-04T05:57:34.983ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972025-03-04T05:57:34.995ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
1982025-03-04T05:57:35.001ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1992025-03-04T05:57:36.294ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002025-03-04T05:57:36.307ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2012025-03-04T05:57:36.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2022025-03-04T05:57:37.338ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032025-03-04T05:57:37.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2042025-03-04T05:57:37.355ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2052025-03-04T05:57:38.674ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062025-03-04T05:57:38.689ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2072025-03-04T05:57:38.696ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2082025-03-04T05:57:41.455ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092025-03-04T05:57:41.472ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
2102025-03-04T05:57:41.473ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2112025-03-04T05:57:41.485ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2122025-03-04T05:57:41.492ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
2132025-03-04T05:57:42.182ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2142025-03-04T05:57:42.185ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 699.464419ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
2152025-03-04T05:57:42.704ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162025-03-04T05:57:42.720ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2172025-03-04T05:57:42.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2182025-03-04T05:57:42.934ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2192025-03-04T05:57:43.642ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202025-03-04T05:57:43.659ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2212025-03-04T05:57:43.667ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2222025-03-04T05:57:44.572ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232025-03-04T05:57:44.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2242025-03-04T05:57:44.587ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2252025-03-04T05:57:46.011ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262025-03-04T05:57:46.022ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2272025-03-04T05:57:46.028ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2282025-03-04T05:57:47.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292025-03-04T05:57:47.517ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2302025-03-04T05:57:47.524ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2312025-03-04T05:57:48.877ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322025-03-04T05:57:48.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2332025-03-04T05:57:48.902ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2342025-03-04T05:57:50.207ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352025-03-04T05:57:50.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2362025-03-04T05:57:50.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2372025-03-04T05:57:51.474ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
2382025-03-04T05:57:51.474ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392025-03-04T05:57:51.485ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2402025-03-04T05:57:51.490ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2412025-03-04T05:57:51.494ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
2422025-03-04T05:57:52.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432025-03-04T05:57:52.187ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2442025-03-04T05:57:52.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2452025-03-04T05:57:53.111ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462025-03-04T05:57:53.121ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2472025-03-04T05:57:53.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2482025-03-04T05:57:53.958ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492025-03-04T05:57:53.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2502025-03-04T05:57:53.972ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2512025-03-04T05:57:55.352ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522025-03-04T05:57:55.362ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2532025-03-04T05:57:55.367ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2542025-03-04T05:57:56.101ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552025-03-04T05:57:56.110ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2562025-03-04T05:57:56.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2572025-03-04T05:57:56.766ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582025-03-04T05:57:56.781ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2592025-03-04T05:57:56.788ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2602025-03-04T05:57:57.935ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2612025-03-04T05:57:57.936ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.318490066s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
2622025-03-04T05:57:58.003ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632025-03-04T05:57:58.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2642025-03-04T05:57:58.022ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2652025-03-04T05:57:58.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662025-03-04T05:57:58.619ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2672025-03-04T05:57:58.625ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2682025-03-04T05:57:59.935ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2692025-03-04T05:57:59.945ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2702025-03-04T05:57:59.950ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2712025-03-04T05:58:00.286ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2722025-03-04T05:58:01.388ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2732025-03-04T05:58:01.401ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2742025-03-04T05:58:01.407ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2752025-03-04T05:58:01.477ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
2762025-03-04T05:58:01.498ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
2772025-03-04T05:58:02.891ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2782025-03-04T05:58:02.902ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2792025-03-04T05:58:02.908ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2802025-03-04T05:58:03.961ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2812025-03-04T05:58:03.972ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2822025-03-04T05:58:03.978ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2832025-03-04T05:58:05.429ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2842025-03-04T05:58:05.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2852025-03-04T05:58:05.448ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2862025-03-04T05:58:06.113ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2872025-03-04T05:58:06.127ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2882025-03-04T05:58:06.134ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2892025-03-04T05:58:06.876ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2902025-03-04T05:58:06.888ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2912025-03-04T05:58:06.894ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2922025-03-04T05:58:07.687ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2932025-03-04T05:58:07.700ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2942025-03-04T05:58:07.707ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2952025-03-04T05:58:08.391ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2962025-03-04T05:58:08.402ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
2972025-03-04T05:58:08.408ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2982025-03-04T05:58:09.914ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2992025-03-04T05:58:09.935ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3002025-03-04T05:58:09.946ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3012025-03-04T05:58:10.952ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3022025-03-04T05:58:10.972ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3032025-03-04T05:58:10.983ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3042025-03-04T05:58:11.482ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
3052025-03-04T05:58:11.500ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
3062025-03-04T05:58:12.217ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3072025-03-04T05:58:12.249ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3082025-03-04T05:58:12.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3092025-03-04T05:58:13.718ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3102025-03-04T05:58:13.737ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3112025-03-04T05:58:13.747ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3122025-03-04T05:58:15.104ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3132025-03-04T05:58:15.119ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3142025-03-04T05:58:15.128ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3152025-03-04T05:58:15.294ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3162025-03-04T05:58:15.298ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.428094056s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
3172025-03-04T05:58:15.849ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182025-03-04T05:58:15.959ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3192025-03-04T05:58:15.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3202025-03-04T05:58:18.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212025-03-04T05:58:18.936ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3222025-03-04T05:58:18.961ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3232025-03-04T05:58:18.978ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3242025-03-04T05:58:20.255ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252025-03-04T05:58:20.315ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3262025-03-04T05:58:20.339ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3272025-03-04T05:58:20.983ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3282025-03-04T05:58:21.002ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3292025-03-04T05:58:21.013ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3302025-03-04T05:58:21.501ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
3312025-03-04T05:58:21.518ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
3322025-03-04T05:58:22.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3332025-03-04T05:58:22.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3342025-03-04T05:58:22.234ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3352025-03-04T05:58:23.062ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3362025-03-04T05:58:23.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3372025-03-04T05:58:23.136ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3382025-03-04T05:58:24.474ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3392025-03-04T05:58:24.500ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3402025-03-04T05:58:24.558ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3412025-03-04T05:58:26.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3422025-03-04T05:58:26.029ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3432025-03-04T05:58:26.041ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3442025-03-04T05:58:26.683ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452025-03-04T05:58:26.701ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3462025-03-04T05:58:26.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3472025-03-04T05:58:27.696ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482025-03-04T05:58:27.711ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3492025-03-04T05:58:27.719ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3502025-03-04T05:58:28.700ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512025-03-04T05:58:28.719ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3522025-03-04T05:58:28.728ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3532025-03-04T05:58:29.911ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542025-03-04T05:58:29.926ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3552025-03-04T05:58:29.933ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3562025-03-04T05:58:30.827ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572025-03-04T05:58:30.842ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3582025-03-04T05:58:30.850ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3592025-03-04T05:58:31.522ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
3602025-03-04T05:58:31.523ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
3612025-03-04T05:58:32.214ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3622025-03-04T05:58:32.246ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3632025-03-04T05:58:32.264ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3642025-03-04T05:58:32.804ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3652025-03-04T05:58:32.830ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3662025-03-04T05:58:32.839ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3672025-03-04T05:58:33.983ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3682025-03-04T05:58:33.988ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.454504378s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
3692025-03-04T05:58:34.349ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3702025-03-04T05:58:34.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3712025-03-04T05:58:34.373ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3722025-03-04T05:58:35.336ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3732025-03-04T05:58:35.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3742025-03-04T05:58:35.354ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3752025-03-04T05:58:36.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762025-03-04T05:58:36.351ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3772025-03-04T05:58:36.356ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3782025-03-04T05:58:37.111ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3792025-03-04T05:58:37.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3802025-03-04T05:58:37.129ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3812025-03-04T05:58:38.147ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3822025-03-04T05:58:38.159ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3832025-03-04T05:58:38.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3842025-03-04T05:58:38.932ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852025-03-04T05:58:38.945ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3862025-03-04T05:58:38.951ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3872025-03-04T05:58:40.058ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882025-03-04T05:58:40.070ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3892025-03-04T05:58:40.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3902025-03-04T05:58:40.673ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912025-03-04T05:58:40.684ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3922025-03-04T05:58:40.689ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3932025-03-04T05:58:41.525ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
3942025-03-04T05:58:41.526ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
3952025-03-04T05:58:41.564ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962025-03-04T05:58:41.575ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
3972025-03-04T05:58:41.580ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3982025-03-04T05:58:42.911ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992025-03-04T05:58:42.923ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4002025-03-04T05:58:42.929ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4012025-03-04T05:58:44.041ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022025-03-04T05:58:44.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4032025-03-04T05:58:44.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4042025-03-04T05:58:44.482ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4052025-03-04T05:58:45.131ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "21aed095-a3ed-4dfc-9546-baebe07c1f2d", "content-length": "133", "date": "Tue, 04 Mar 2025 05:58:44 GMT"} }) unit = producer-server
4062025-03-04T05:58:45.133ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 15.803072494s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"21aed095-a3ed-4dfc-9546-baebe07c1f2d\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Tue, 04 Mar 2025 05:58:44 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"21aed095-a3ed-4dfc-9546-baebe07c1f2d\\" }" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
4072025-03-04T05:58:45.296ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082025-03-04T05:58:45.308ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4092025-03-04T05:58:45.325ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4102025-03-04T05:58:46.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112025-03-04T05:58:46.477ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4122025-03-04T05:58:46.482ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4132025-03-04T05:58:47.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142025-03-04T05:58:47.309ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4152025-03-04T05:58:47.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4162025-03-04T05:58:48.587ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172025-03-04T05:58:48.598ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4182025-03-04T05:58:48.603ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4192025-03-04T05:58:49.255ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202025-03-04T05:58:49.269ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4212025-03-04T05:58:49.275ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4222025-03-04T05:58:50.600ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4232025-03-04T05:58:50.613ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4242025-03-04T05:58:50.622ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4252025-03-04T05:58:51.528ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
4262025-03-04T05:58:51.529ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
4272025-03-04T05:58:51.887ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4282025-03-04T05:58:51.899ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4292025-03-04T05:58:51.904ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4302025-03-04T05:58:52.541ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4312025-03-04T05:58:52.552ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4322025-03-04T05:58:52.557ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4332025-03-04T05:58:53.445ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4342025-03-04T05:58:53.458ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4352025-03-04T05:58:53.464ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4362025-03-04T05:58:54.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372025-03-04T05:58:54.320ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4382025-03-04T05:58:54.327ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4392025-03-04T05:58:55.825ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402025-03-04T05:58:55.837ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4412025-03-04T05:58:55.843ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4422025-03-04T05:58:57.160ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4432025-03-04T05:58:57.172ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4442025-03-04T05:58:57.177ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4452025-03-04T05:58:57.819ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462025-03-04T05:58:57.830ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4472025-03-04T05:58:57.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4482025-03-04T05:58:58.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4492025-03-04T05:58:58.579ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4502025-03-04T05:58:58.584ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4512025-03-04T05:58:59.673ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4522025-03-04T05:58:59.684ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4532025-03-04T05:58:59.690ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4542025-03-04T05:59:00.558ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4552025-03-04T05:59:00.569ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4562025-03-04T05:59:00.575ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4572025-03-04T05:59:00.974ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4582025-03-04T05:59:00.986ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8f4d7ba2-56d5-4cce-8866-2398e27c66cb", "content-length": "41", "date": "Tue, 04 Mar 2025 05:59:00 GMT"} }) unit = producer-server
4592025-03-04T05:59:00.986ZDEBGtfportd (producer-registration-task): registered with nexus successfully unit = producer-server
4602025-03-04T05:59:00.986ZDEBGtfportd (producer-registration-task): pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4612025-03-04T05:59:01.526ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622025-03-04T05:59:01.532ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
4632025-03-04T05:59:01.533ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
4642025-03-04T05:59:01.539ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4652025-03-04T05:59:01.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4662025-03-04T05:59:02.457ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672025-03-04T05:59:02.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4682025-03-04T05:59:02.474ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4692025-03-04T05:59:03.023ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702025-03-04T05:59:03.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4712025-03-04T05:59:03.041ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4722025-03-04T05:59:03.937ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732025-03-04T05:59:03.950ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4742025-03-04T05:59:03.957ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4752025-03-04T05:59:05.147ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762025-03-04T05:59:05.159ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4772025-03-04T05:59:05.164ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4782025-03-04T05:59:06.670ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792025-03-04T05:59:06.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4802025-03-04T05:59:06.688ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4812025-03-04T05:59:07.516ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822025-03-04T05:59:07.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4832025-03-04T05:59:07.535ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4842025-03-04T05:59:08.729ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852025-03-04T05:59:08.741ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4862025-03-04T05:59:08.746ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4872025-03-04T05:59:09.931ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882025-03-04T05:59:09.943ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4892025-03-04T05:59:09.949ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4902025-03-04T05:59:11.304ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912025-03-04T05:59:11.316ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4922025-03-04T05:59:11.322ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4932025-03-04T05:59:11.536ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
4942025-03-04T05:59:11.536ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
4952025-03-04T05:59:12.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962025-03-04T05:59:12.651ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
4972025-03-04T05:59:12.657ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4982025-03-04T05:59:14.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992025-03-04T05:59:14.040ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5002025-03-04T05:59:14.046ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5012025-03-04T05:59:14.601ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022025-03-04T05:59:14.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5032025-03-04T05:59:14.618ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5042025-03-04T05:59:16.072ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5052025-03-04T05:59:16.085ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5062025-03-04T05:59:16.091ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5072025-03-04T05:59:17.509ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5082025-03-04T05:59:17.521ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5092025-03-04T05:59:17.526ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5102025-03-04T05:59:18.643ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5112025-03-04T05:59:18.655ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5122025-03-04T05:59:18.661ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5132025-03-04T05:59:19.431ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5142025-03-04T05:59:19.444ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5152025-03-04T05:59:19.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5162025-03-04T05:59:20.328ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5172025-03-04T05:59:20.342ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5182025-03-04T05:59:20.348ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5192025-03-04T05:59:21.276ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5202025-03-04T05:59:21.290ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5212025-03-04T05:59:21.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5222025-03-04T05:59:21.540ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
5232025-03-04T05:59:21.540ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
5242025-03-04T05:59:21.822ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252025-03-04T05:59:21.835ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5262025-03-04T05:59:21.841ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5272025-03-04T05:59:23.036ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282025-03-04T05:59:23.049ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5292025-03-04T05:59:23.055ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5302025-03-04T05:59:24.544ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312025-03-04T05:59:24.556ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5322025-03-04T05:59:24.563ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5332025-03-04T05:59:26.006ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342025-03-04T05:59:26.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5352025-03-04T05:59:26.026ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5362025-03-04T05:59:27.444ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5372025-03-04T05:59:27.457ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5382025-03-04T05:59:27.464ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5392025-03-04T05:59:28.475ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5402025-03-04T05:59:28.490ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5412025-03-04T05:59:28.496ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5422025-03-04T05:59:29.063ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5432025-03-04T05:59:29.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5442025-03-04T05:59:29.082ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5452025-03-04T05:59:30.436ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5462025-03-04T05:59:30.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5472025-03-04T05:59:30.452ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5482025-03-04T05:59:31.543ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
5492025-03-04T05:59:31.544ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
5502025-03-04T05:59:31.860ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5512025-03-04T05:59:31.873ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5522025-03-04T05:59:31.879ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5532025-03-04T05:59:33.059ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5542025-03-04T05:59:33.071ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5552025-03-04T05:59:33.077ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5562025-03-04T05:59:34.561ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5572025-03-04T05:59:34.574ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5582025-03-04T05:59:34.579ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5592025-03-04T05:59:35.383ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602025-03-04T05:59:35.395ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5612025-03-04T05:59:35.400ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5622025-03-04T05:59:36.204ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5632025-03-04T05:59:36.217ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5642025-03-04T05:59:36.224ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5652025-03-04T05:59:37.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5662025-03-04T05:59:37.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5672025-03-04T05:59:37.540ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5682025-03-04T05:59:38.906ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5692025-03-04T05:59:38.919ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5702025-03-04T05:59:38.930ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5712025-03-04T05:59:40.299ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5722025-03-04T05:59:40.311ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5732025-03-04T05:59:40.317ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5742025-03-04T05:59:41.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5752025-03-04T05:59:41.052ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5762025-03-04T05:59:41.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5772025-03-04T05:59:41.548ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
5782025-03-04T05:59:41.549ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
5792025-03-04T05:59:41.728ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5802025-03-04T05:59:41.742ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5812025-03-04T05:59:41.749ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5822025-03-04T05:59:42.656ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5832025-03-04T05:59:42.668ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5842025-03-04T05:59:42.674ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5852025-03-04T05:59:43.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5862025-03-04T05:59:43.820ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5872025-03-04T05:59:43.825ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5882025-03-04T05:59:44.727ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5892025-03-04T05:59:44.740ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5902025-03-04T05:59:44.746ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5912025-03-04T05:59:45.240ZINFOtfportd (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::2]:50142 remote_addr = [fd00:1122:3344:101::d]:36928 unit = producer-server
5922025-03-04T05:59:45.254ZINFOtfportd (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 11912 local_addr = [fd00:1122:3344:101::2]:50142 method = GET remote_addr = [fd00:1122:3344:101::d]:36928 req_id = 75586d6c-68f4-4a88-a7ad-bb802bf707ed response_code = 200 unit = producer-server uri = /10e7a388-4f20-4ec9-94e4-cacb04dd1c65
5932025-03-04T05:59:45.878ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5942025-03-04T05:59:45.890ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5952025-03-04T05:59:45.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5962025-03-04T05:59:46.852ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5972025-03-04T05:59:46.864ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
5982025-03-04T05:59:46.869ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5992025-03-04T05:59:47.422ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6002025-03-04T05:59:47.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6012025-03-04T05:59:47.439ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6022025-03-04T05:59:48.468ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6032025-03-04T05:59:48.481ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6042025-03-04T05:59:48.488ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6052025-03-04T05:59:49.766ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6062025-03-04T05:59:49.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6072025-03-04T05:59:49.784ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6082025-03-04T05:59:50.642ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6092025-03-04T05:59:50.669ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6102025-03-04T05:59:50.676ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6112025-03-04T05:59:51.552ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
6122025-03-04T05:59:51.552ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter
6132025-03-04T05:59:52.141ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6142025-03-04T05:59:52.153ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6152025-03-04T05:59:52.159ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6162025-03-04T05:59:53.262ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6172025-03-04T05:59:53.274ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6182025-03-04T05:59:53.279ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6192025-03-04T05:59:54.458ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6202025-03-04T05:59:54.472ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6212025-03-04T05:59:54.479ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6222025-03-04T05:59:55.938ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6232025-03-04T05:59:55.950ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6242025-03-04T05:59:55.956ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6252025-03-04T05:59:57.122ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6262025-03-04T05:59:57.143ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6272025-03-04T05:59:57.148ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6282025-03-04T05:59:58.654ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6292025-03-04T05:59:58.667ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6302025-03-04T05:59:58.673ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6312025-03-04T05:59:59.698ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6322025-03-04T05:59:59.711ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6332025-03-04T05:59:59.717ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6342025-03-04T06:00:00.321ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6352025-03-04T06:00:00.338ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6362025-03-04T06:00:00.345ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6372025-03-04T06:00:01.510ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6382025-03-04T06:00:01.525ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c04:eaff:fee1:3fb]
6392025-03-04T06:00:01.533ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6402025-03-04T06:00:01.556ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3581369307375137540 n_samples = 6 unit = oximeter
6412025-03-04T06:00:01.556ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15802405230886637707 n_samples = 6 unit = oximeter