Max level shown:
1 [ Feb 28 10:57:44 Enabled. ]
2 [ Feb 28 10:57:44 Rereading configuration. ]
3 [ Feb 28 10:57:45 Rereading configuration. ]
4 [ Feb 28 10:57:56 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Feb 28 10:57:56 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-02-28T10:57:56.152ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-02-28T10:57:56.270ZINFOtfportd: connected to dpd running softnpu-b37a8fdc-dirty
92025-02-28T10:57:56.270ZINFOtfportd: running in sync-only mode
102025-02-28T10:57:56.271ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-02-28T10:57:56.307ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-02-28T10:57:56.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
142025-02-28T10:57:56.324ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( d262f7b2-3307-4559-9ee9-e967c445259f, ), sled_id: Some( e34399da-90ab-4780-9b78-9879d23c2d5f, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
152025-02-28T10:57:56.324ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
162025-02-28T10:57:56.325ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::48d5:51ff:fef6:3239->4a:d5:51:f6:32:39 interface = tfportrear0_0
172025-02-28T10:57:56.325ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::58b7:91ff:fe63:a6ac->5a:b7:91:63:a6:ac interface = tfportrear0_0
182025-02-28T10:57:56.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
192025-02-28T10:57:56.371ZWARNtfportd: tfportqsfp0_0 has no addrs
20 [ Feb 28 10:57:57 Rereading configuration. ]
21 [ Feb 28 10:57:57 Executing refresh method (:kill). ]
22 [ Feb 28 10:57:57 Stopping because all processes in service exited. ]
23 [ Feb 28 10:57:57 Executing stop method (:kill). ]
24 [ Feb 28 10:57:57 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ Feb 28 10:57:57 Method "start" exited with status 0. ]
262025-02-28T10:57:57.063ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272025-02-28T10:57:57.114ZINFOtfportd: connected to dpd running softnpu-b37a8fdc-dirty
282025-02-28T10:57:57.115ZINFOtfportd: running in sync-only mode
292025-02-28T10:57:57.115ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302025-02-28T10:57:57.122ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312025-02-28T10:57:57.125ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, sled_id: e34399da-90ab-4780-9b78-9879d23c2d5f, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 99dbb403-9e2f-4db2-9e21-0379a0ba4a7d, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322025-02-28T10:57:57.125ZDEBGtfportd: created producer ID producer_id = a8fada6b-3d83-4f6b-9bb0-7267b6c342bd unit = oximeter
332025-02-28T10:57:57.126ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( d262f7b2-3307-4559-9ee9-e967c445259f, ), sled_id: Some( e34399da-90ab-4780-9b78-9879d23c2d5f, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
342025-02-28T10:57:57.130ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::48d5:51ff:fef6:3239->4a:d5:51:f6:32:39 interface = tfportrear0_0
352025-02-28T10:57:57.130ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::58b7:91ff:fe63:a6ac->5a:b7:91:63:a6:ac interface = tfportrear0_0
362025-02-28T10:57:57.132ZDEBGtfportd: registered DTrace probes unit = producer-server
372025-02-28T10:57:57.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
382025-02-28T10:57:57.136ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:41410 method = GET path = /{producer_id} unit = producer-server versions = all
392025-02-28T10:57:57.136ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:41410 unit = producer-server
402025-02-28T10:57:57.136ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:41410 unit = producer-server
412025-02-28T10:57:57.136ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:41410 unit = producer-server
422025-02-28T10:57:57.136ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432025-02-28T10:57:57.136ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/internal-dns/resolver/src/resolver.rs:111 unit = producer-server
442025-02-28T10:57:57.137ZDEBGtfportd: starting producer registration task unit = producer-server
452025-02-28T10:57:57.137ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:41410 file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = a8fada6b-3d83-4f6b-9bb0-7267b6c342bd unit = producer-server
462025-02-28T10:57:57.137ZINFOtfportd: created oximeter producer server unit = oximeter
472025-02-28T10:57:57.137ZDEBGtfportd (producer-registration-task): registering / renewing oximeter producer lease with Nexus unit = producer-server
482025-02-28T10:57:57.145ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
492025-02-28T10:57:57.149ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-02-28T10:57:39.840555906Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502025-02-28T10:57:57.149ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 12630121199257682296 unit = oximeter
512025-02-28T10:57:57.149ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522025-02-28T10:57:57.151ZWARNtfportd: tfportqsfp0_0 has no addrs
532025-02-28T10:57:58.087ZINFOtfportd: added new ARP entry entry = 10.151.2.174->5a:f0:3a:54:2a:29 interface = tfportqsfp0_0
542025-02-28T10:57:58.181ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552025-02-28T10:57:58.191ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
562025-02-28T10:57:58.196ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
572025-02-28T10:57:58.197ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-02-28T10:57:39.840418705Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
582025-02-28T10:57:58.197ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 9847185509670185764 unit = oximeter
592025-02-28T10:57:58.197ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
602025-02-28T10:57:59.319ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
612025-02-28T10:57:59.330ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
622025-02-28T10:57:59.335ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
632025-02-28T10:58:00.081ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
642025-02-28T10:58:00.091ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
652025-02-28T10:58:00.096ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
662025-02-28T10:58:01.277ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
672025-02-28T10:58:01.290ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
682025-02-28T10:58:01.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
692025-02-28T10:58:02.140ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("74f1547b-a833-4952-b80e-4986ebf8427a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80b2977d-cb89-4acf-9305-fe891d3444ad.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d72a02ec-7939-4df2-9449-a9fb85ed7ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d72a02ec-7939-4df2-9449-a9fb85ed7ae8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::c))) }], valid_until: Instant { tv_sec: 2463, tv_nsec: 709053532 } }) unit = producer-server
702025-02-28T10:58:02.140ZDEBGtfportd (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221 unit = producer-server
712025-02-28T10:58:02.172ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
722025-02-28T10:58:02.184ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
732025-02-28T10:58:02.195ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
742025-02-28T10:58:02.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
752025-02-28T10:58:02.865ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
762025-02-28T10:58:02.875ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
772025-02-28T10:58:02.881ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
782025-02-28T10:58:04.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
792025-02-28T10:58:04.049ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
802025-02-28T10:58:04.054ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
812025-02-28T10:58:04.784ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
822025-02-28T10:58:04.796ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
832025-02-28T10:58:04.802ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
842025-02-28T10:58:06.263ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
852025-02-28T10:58:06.274ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
862025-02-28T10:58:06.280ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
872025-02-28T10:58:07.042ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882025-02-28T10:58:07.052ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
892025-02-28T10:58:07.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
902025-02-28T10:58:07.154ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
912025-02-28T10:58:08.200ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
922025-02-28T10:58:08.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932025-02-28T10:58:08.516ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
942025-02-28T10:58:08.521ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
952025-02-28T10:58:09.252ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
962025-02-28T10:58:09.263ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
972025-02-28T10:58:09.268ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
982025-02-28T10:58:10.329ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
992025-02-28T10:58:10.340ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1002025-02-28T10:58:10.345ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1012025-02-28T10:58:10.896ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1022025-02-28T10:58:10.906ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1032025-02-28T10:58:10.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1042025-02-28T10:58:11.776ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1052025-02-28T10:58:11.787ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1062025-02-28T10:58:11.792ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1072025-02-28T10:58:13.076ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1082025-02-28T10:58:13.086ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1092025-02-28T10:58:13.092ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1102025-02-28T10:58:14.277ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1112025-02-28T10:58:14.287ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1122025-02-28T10:58:14.291ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1132025-02-28T10:58:15.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1142025-02-28T10:58:15.167ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1152025-02-28T10:58:15.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1162025-02-28T10:58:15.645ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172025-02-28T10:58:15.655ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1182025-02-28T10:58:15.660ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1192025-02-28T10:58:16.634ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1202025-02-28T10:58:16.645ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1212025-02-28T10:58:16.650ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1222025-02-28T10:58:16.770ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
1232025-02-28T10:58:16.787ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1242025-02-28T10:58:16.789ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 226.980856ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
1252025-02-28T10:58:17.047ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1262025-02-28T10:58:17.210ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272025-02-28T10:58:17.221ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1282025-02-28T10:58:17.226ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1292025-02-28T10:58:17.819ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
1302025-02-28T10:58:18.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312025-02-28T10:58:18.216ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1322025-02-28T10:58:18.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1332025-02-28T10:58:19.606ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342025-02-28T10:58:19.618ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1352025-02-28T10:58:19.624ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1362025-02-28T10:58:20.371ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372025-02-28T10:58:20.383ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1382025-02-28T10:58:20.390ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392025-02-28T10:58:21.767ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402025-02-28T10:58:21.799ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1412025-02-28T10:58:21.813ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1422025-02-28T10:58:22.606ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432025-02-28T10:58:22.622ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1442025-02-28T10:58:22.629ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1452025-02-28T10:58:23.851ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462025-02-28T10:58:23.866ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1472025-02-28T10:58:23.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1482025-02-28T10:58:25.342ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-02-28T10:58:25.353ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1502025-02-28T10:58:25.359ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512025-02-28T10:58:26.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522025-02-28T10:58:26.562ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1532025-02-28T10:58:26.568ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1542025-02-28T10:58:26.800ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
1552025-02-28T10:58:27.365ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562025-02-28T10:58:27.378ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1572025-02-28T10:58:27.385ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1582025-02-28T10:58:27.851ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
1592025-02-28T10:58:28.313ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602025-02-28T10:58:28.326ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1612025-02-28T10:58:28.332ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1622025-02-28T10:58:29.524ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632025-02-28T10:58:29.535ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1642025-02-28T10:58:29.540ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1652025-02-28T10:58:30.660ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662025-02-28T10:58:30.672ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1672025-02-28T10:58:30.678ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1682025-02-28T10:58:31.676ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692025-02-28T10:58:31.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1702025-02-28T10:58:31.694ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1712025-02-28T10:58:32.090ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1722025-02-28T10:58:32.091ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 690.93061ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
1732025-02-28T10:58:32.366ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742025-02-28T10:58:32.378ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1752025-02-28T10:58:32.386ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1762025-02-28T10:58:32.817ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1772025-02-28T10:58:33.496ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782025-02-28T10:58:33.509ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1792025-02-28T10:58:33.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1802025-02-28T10:58:34.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812025-02-28T10:58:34.673ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1822025-02-28T10:58:34.680ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1832025-02-28T10:58:35.402ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842025-02-28T10:58:35.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1852025-02-28T10:58:35.435ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1862025-02-28T10:58:40.616ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872025-02-28T10:58:40.701ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1882025-02-28T10:58:40.701ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
1892025-02-28T10:58:40.702ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
1902025-02-28T10:58:40.714ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1912025-02-28T10:58:41.488ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922025-02-28T10:58:41.506ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1932025-02-28T10:58:41.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1942025-02-28T10:58:42.488ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952025-02-28T10:58:42.505ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1962025-02-28T10:58:42.514ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1972025-02-28T10:58:43.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1982025-02-28T10:58:43.534ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
1992025-02-28T10:58:43.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2002025-02-28T10:58:44.082ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012025-02-28T10:58:44.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2022025-02-28T10:58:44.106ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2032025-02-28T10:58:45.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042025-02-28T10:58:45.166ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2052025-02-28T10:58:45.175ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2062025-02-28T10:58:46.301ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072025-02-28T10:58:46.314ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2082025-02-28T10:58:46.319ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2092025-02-28T10:58:47.083ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102025-02-28T10:58:47.094ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2112025-02-28T10:58:47.100ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2122025-02-28T10:58:47.831ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2132025-02-28T10:58:47.833ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 601.456718ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
2142025-02-28T10:58:48.253ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152025-02-28T10:58:48.264ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2162025-02-28T10:58:48.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2172025-02-28T10:58:48.469ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2182025-02-28T10:58:49.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192025-02-28T10:58:49.065ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2202025-02-28T10:58:49.070ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2212025-02-28T10:58:50.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222025-02-28T10:58:50.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2232025-02-28T10:58:50.355ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2242025-02-28T10:58:50.708ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
2252025-02-28T10:58:50.708ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
2262025-02-28T10:58:51.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2272025-02-28T10:58:51.429ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2282025-02-28T10:58:51.434ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2292025-02-28T10:58:52.759ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2302025-02-28T10:58:52.770ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2312025-02-28T10:58:52.775ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2322025-02-28T10:58:53.728ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2332025-02-28T10:58:53.739ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2342025-02-28T10:58:53.744ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2352025-02-28T10:58:55.222ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2362025-02-28T10:58:55.239ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2372025-02-28T10:58:55.250ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2382025-02-28T10:58:56.643ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392025-02-28T10:58:56.653ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2402025-02-28T10:58:56.658ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2412025-02-28T10:58:57.301ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2422025-02-28T10:58:57.311ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2432025-02-28T10:58:57.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2442025-02-28T10:58:58.082ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2452025-02-28T10:58:58.093ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2462025-02-28T10:58:58.098ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2472025-02-28T10:58:59.234ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2482025-02-28T10:58:59.244ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2492025-02-28T10:58:59.250ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2502025-02-28T10:59:00.042ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2512025-02-28T10:59:00.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2522025-02-28T10:59:00.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2532025-02-28T10:59:00.712ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
2542025-02-28T10:59:00.712ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
2552025-02-28T10:59:01.516ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562025-02-28T10:59:01.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2572025-02-28T10:59:01.533ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2582025-02-28T10:59:02.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592025-02-28T10:59:02.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2602025-02-28T10:59:02.355ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2612025-02-28T10:59:03.447ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622025-02-28T10:59:03.458ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2632025-02-28T10:59:03.463ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2642025-02-28T10:59:03.472ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2652025-02-28T10:59:03.473ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.197443293s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
2662025-02-28T10:59:04.554ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672025-02-28T10:59:04.566ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2682025-02-28T10:59:04.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2692025-02-28T10:59:05.232ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702025-02-28T10:59:05.244ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2712025-02-28T10:59:05.250ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2722025-02-28T10:59:05.702ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2732025-02-28T10:59:06.428ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742025-02-28T10:59:06.439ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2752025-02-28T10:59:06.444ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2762025-02-28T10:59:07.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772025-02-28T10:59:07.038ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2782025-02-28T10:59:07.043ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2792025-02-28T10:59:08.108ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802025-02-28T10:59:08.119ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2812025-02-28T10:59:08.124ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2822025-02-28T10:59:08.666ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832025-02-28T10:59:08.678ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2842025-02-28T10:59:08.683ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2852025-02-28T10:59:09.653ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862025-02-28T10:59:09.666ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2872025-02-28T10:59:09.672ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2882025-02-28T10:59:10.713ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
2892025-02-28T10:59:10.713ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
2902025-02-28T10:59:10.884ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912025-02-28T10:59:10.898ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2922025-02-28T10:59:10.907ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2932025-02-28T10:59:12.263ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942025-02-28T10:59:12.276ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2952025-02-28T10:59:12.283ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2962025-02-28T10:59:13.519ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972025-02-28T10:59:13.531ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
2982025-02-28T10:59:13.537ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2992025-02-28T10:59:14.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002025-02-28T10:59:14.928ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3012025-02-28T10:59:14.945ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3022025-02-28T10:59:15.915ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032025-02-28T10:59:15.936ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3042025-02-28T10:59:15.947ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3052025-02-28T10:59:17.485ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062025-02-28T10:59:17.529ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3072025-02-28T10:59:17.565ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3082025-02-28T10:59:19.078ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092025-02-28T10:59:19.094ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3102025-02-28T10:59:19.103ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3112025-02-28T10:59:20.622ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122025-02-28T10:59:20.639ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3132025-02-28T10:59:20.648ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3142025-02-28T10:59:20.704ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3152025-02-28T10:59:20.709ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.400494905s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
3162025-02-28T10:59:20.738ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
3172025-02-28T10:59:20.740ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
3182025-02-28T10:59:22.100ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3192025-02-28T10:59:22.205ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3202025-02-28T10:59:22.250ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3212025-02-28T10:59:23.031ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222025-02-28T10:59:23.048ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3232025-02-28T10:59:23.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3242025-02-28T10:59:23.165ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3252025-02-28T10:59:24.412ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262025-02-28T10:59:24.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3272025-02-28T10:59:24.434ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3282025-02-28T10:59:25.284ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292025-02-28T10:59:25.302ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3302025-02-28T10:59:25.310ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3312025-02-28T10:59:26.052ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322025-02-28T10:59:26.068ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3332025-02-28T10:59:26.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3342025-02-28T10:59:26.930ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3352025-02-28T10:59:26.946ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3362025-02-28T10:59:26.954ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3372025-02-28T10:59:27.663ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3382025-02-28T10:59:27.680ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3392025-02-28T10:59:27.688ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3402025-02-28T10:59:29.177ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3412025-02-28T10:59:29.188ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3422025-02-28T10:59:29.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3432025-02-28T10:59:30.705ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3442025-02-28T10:59:30.715ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3452025-02-28T10:59:30.721ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3462025-02-28T10:59:30.742ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
3472025-02-28T10:59:30.774ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
3482025-02-28T10:59:31.293ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492025-02-28T10:59:31.304ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3502025-02-28T10:59:31.309ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3512025-02-28T10:59:32.576ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522025-02-28T10:59:32.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3532025-02-28T10:59:32.658ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3542025-02-28T10:59:33.444ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552025-02-28T10:59:33.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3562025-02-28T10:59:33.539ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3572025-02-28T10:59:35.001ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582025-02-28T10:59:35.409ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3592025-02-28T10:59:35.423ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3602025-02-28T10:59:36.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612025-02-28T10:59:36.850ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3622025-02-28T10:59:36.866ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3632025-02-28T10:59:37.632ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642025-02-28T10:59:37.652ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3652025-02-28T10:59:37.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3662025-02-28T10:59:38.166ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3672025-02-28T10:59:38.168ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.083475421s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
3682025-02-28T10:59:38.314ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692025-02-28T10:59:38.332ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3702025-02-28T10:59:38.342ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3712025-02-28T10:59:39.378ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722025-02-28T10:59:39.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3732025-02-28T10:59:39.405ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3742025-02-28T10:59:40.532ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752025-02-28T10:59:40.550ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3762025-02-28T10:59:40.560ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3772025-02-28T10:59:40.778ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
3782025-02-28T10:59:40.780ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
3792025-02-28T10:59:41.377ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802025-02-28T10:59:41.399ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3812025-02-28T10:59:41.415ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3822025-02-28T10:59:42.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832025-02-28T10:59:42.516ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3842025-02-28T10:59:42.525ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3852025-02-28T10:59:43.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862025-02-28T10:59:43.203ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3872025-02-28T10:59:43.210ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3882025-02-28T10:59:44.599ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3892025-02-28T10:59:44.615ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3902025-02-28T10:59:44.622ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3912025-02-28T10:59:45.555ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922025-02-28T10:59:45.569ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3932025-02-28T10:59:45.576ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3942025-02-28T10:59:47.047ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952025-02-28T10:59:47.059ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3962025-02-28T10:59:47.065ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3972025-02-28T10:59:47.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3982025-02-28T10:59:47.670ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
3992025-02-28T10:59:47.676ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4002025-02-28T10:59:48.284ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4012025-02-28T10:59:48.287ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
4022025-02-28T10:59:48.287ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.120270852s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/78772ea/oximeter/producer/src/lib.rs:420 unit = producer-server
4032025-02-28T10:59:48.382ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4042025-02-28T10:59:48.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4052025-02-28T10:59:48.399ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4062025-02-28T10:59:49.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4072025-02-28T10:59:49.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4082025-02-28T10:59:49.204ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4092025-02-28T10:59:49.840ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4102025-02-28T10:59:49.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4112025-02-28T10:59:49.858ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4122025-02-28T10:59:50.492ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4132025-02-28T10:59:50.504ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4142025-02-28T10:59:50.510ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4152025-02-28T10:59:50.781ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
4162025-02-28T10:59:50.782ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter
4172025-02-28T10:59:51.657ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182025-02-28T10:59:51.668ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4192025-02-28T10:59:51.673ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4202025-02-28T10:59:52.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212025-02-28T10:59:52.898ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4222025-02-28T10:59:52.904ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4232025-02-28T10:59:53.807ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242025-02-28T10:59:53.819ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4252025-02-28T10:59:53.825ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4262025-02-28T10:59:54.534ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272025-02-28T10:59:54.544ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4282025-02-28T10:59:54.549ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4292025-02-28T10:59:55.415ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302025-02-28T10:59:55.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4312025-02-28T10:59:55.434ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4322025-02-28T10:59:56.211ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332025-02-28T10:59:56.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4342025-02-28T10:59:56.230ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4352025-02-28T10:59:56.816ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362025-02-28T10:59:56.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4372025-02-28T10:59:56.834ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4382025-02-28T10:59:57.446ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4392025-02-28T10:59:57.479ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402025-02-28T10:59:57.492ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4412025-02-28T10:59:57.498ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4422025-02-28T10:59:57.621ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "42b40d01-cb23-4305-a86c-8cacc472a586", "content-length": "41", "date": "Fri, 28 Feb 2025 10:59:56 GMT"} }) unit = producer-server
4432025-02-28T10:59:57.624ZDEBGtfportd (producer-registration-task): registered with nexus successfully unit = producer-server
4442025-02-28T10:59:57.624ZDEBGtfportd (producer-registration-task): pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4452025-02-28T10:59:58.758ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462025-02-28T10:59:58.772ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4472025-02-28T10:59:58.779ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4482025-02-28T11:00:00.215ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4492025-02-28T11:00:00.235ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::58b7:91ff:fe63:a6ac]
4502025-02-28T11:00:00.244ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4512025-02-28T11:00:00.785ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12630121199257682296 n_samples = 6 unit = oximeter
4522025-02-28T11:00:00.786ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9847185509670185764 n_samples = 6 unit = oximeter