Max level shown:
1 [ Apr 15 03:58:26 Enabled. ]
2 [ Apr 15 03:58:26 Rereading configuration. ]
3 [ Apr 15 03:58:27 Rereading configuration. ]
4 [ Apr 15 03:58:38 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Apr 15 03:58:38 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-04-15T03:58:38.656ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-04-15T03:58:38.697ZINFOtfportd: connected to dpd running softnpu-0dcd325b
92025-04-15T03:58:38.697ZINFOtfportd: running in sync-only mode
102025-04-15T03:58:38.697ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-04-15T03:58:38.704ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-04-15T03:58:38.708ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( a7b3b41b-e934-461f-90fe-484070291b80, ), sled_id: Some( b878a3ef-2707-4377-a3db-fe16cceb11de, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142025-04-15T03:58:38.708ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-04-15T03:58:38.713ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
162025-04-15T03:58:38.716ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::2441:7cff:fedc:100a->26:41:7c:dc:10:0a interface = tfportrear0_0
172025-04-15T03:58:38.724ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
182025-04-15T03:58:38.731ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Apr 15 03:58:39 Rereading configuration. ]
20 [ Apr 15 03:58:39 Executing refresh method (:kill). ]
21 [ Apr 15 03:58:39 Stopping because all processes in service exited. ]
22 [ Apr 15 03:58:39 Executing stop method (:kill). ]
23 [ Apr 15 03:58:39 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Apr 15 03:58:39 Method "start" exited with status 0. ]
252025-04-15T03:58:39.329ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262025-04-15T03:58:39.371ZINFOtfportd: connected to dpd running softnpu-0dcd325b
272025-04-15T03:58:39.371ZINFOtfportd: running in sync-only mode
282025-04-15T03:58:39.371ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292025-04-15T03:58:39.378ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: a7b3b41b-e934-461f-90fe-484070291b80, sled_id: b878a3ef-2707-4377-a3db-fe16cceb11de, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: c6ec49e0-60c6-4d82-a176-5d16acc0207c, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
302025-04-15T03:58:39.380ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312025-04-15T03:58:39.380ZDEBGtfportd: created producer ID producer_id = d9275e14-aef5-48ea-9253-eb4010022a22 unit = oximeter
322025-04-15T03:58:39.382ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( a7b3b41b-e934-461f-90fe-484070291b80, ), sled_id: Some( b878a3ef-2707-4377-a3db-fe16cceb11de, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332025-04-15T03:58:39.388ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342025-04-15T03:58:39.392ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f0f2:d4ff:feed:8d50->f2:f2:d4:ed:8d:50 interface = tfportrear0_0
352025-04-15T03:58:39.392ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::2441:7cff:fedc:100a->26:41:7c:dc:10:0a interface = tfportrear0_0
362025-04-15T03:58:39.392ZDEBGtfportd: registered DTrace probes unit = producer-server
372025-04-15T03:58:39.393ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:59718 method = GET path = /{producer_id} unit = producer-server versions = all
382025-04-15T03:58:39.393ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:59718 unit = producer-server
392025-04-15T03:58:39.393ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:59718 unit = producer-server
402025-04-15T03:58:39.393ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:59718 unit = producer-server
412025-04-15T03:58:39.393ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422025-04-15T03:58:39.393ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/internal-dns/resolver/src/resolver.rs:111 unit = producer-server
432025-04-15T03:58:39.393ZDEBGtfportd: starting producer registration task unit = producer-server
442025-04-15T03:58:39.393ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:59718 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = d9275e14-aef5-48ea-9253-eb4010022a22 unit = producer-server
452025-04-15T03:58:39.393ZINFOtfportd: created oximeter producer server unit = oximeter
462025-04-15T03:58:39.393ZDEBGtfportd (producer-registration-task): registering / renewing oximeter producer lease with Nexus unit = producer-server
472025-04-15T03:58:39.400ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
482025-04-15T03:58:39.401ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-04-15T03:58:22.402281106Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
492025-04-15T03:58:39.401ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 2336860567283387716 unit = oximeter
502025-04-15T03:58:39.401ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
512025-04-15T03:58:39.407ZWARNtfportd: tfportqsfp0_0 has no addrs
522025-04-15T03:58:40.484ZINFOtfportd: added new ARP entry entry = 10.151.1.174->f6:da:d3:b6:53:d1 interface = tfportqsfp0_0
532025-04-15T03:58:40.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
542025-04-15T03:58:40.595ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
552025-04-15T03:58:40.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
562025-04-15T03:58:40.604ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-04-15T03:58:22.402146062Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
572025-04-15T03:58:40.604ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 4604029511534947471 unit = oximeter
582025-04-15T03:58:40.604ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
592025-04-15T03:58:41.878ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
602025-04-15T03:58:41.890ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
612025-04-15T03:58:41.897ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
622025-04-15T03:58:42.936ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
632025-04-15T03:58:42.947ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
642025-04-15T03:58:42.952ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
652025-04-15T03:58:44.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662025-04-15T03:58:44.428ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
672025-04-15T03:58:44.434ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
682025-04-15T03:58:45.539ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692025-04-15T03:58:45.549ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
702025-04-15T03:58:45.555ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
712025-04-15T03:58:46.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
722025-04-15T03:58:46.315ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
732025-04-15T03:58:46.320ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
742025-04-15T03:58:47.821ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752025-04-15T03:58:47.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
762025-04-15T03:58:47.838ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
772025-04-15T03:58:49.144ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782025-04-15T03:58:49.154ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
792025-04-15T03:58:49.159ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
802025-04-15T03:58:49.398ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("527069c3-e732-4ddb-a5bc-380dcdd7efde.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("909a489c-1cdb-4440-bdff-c8667de265bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2373202-6a37-4079-9fde-976f12481944.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c2373202-6a37-4079-9fde-976f12481944.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::a))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 340537796 } }) unit = producer-server
812025-04-15T03:58:49.399ZDEBGtfportd (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221 unit = producer-server
822025-04-15T03:58:49.431ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
832025-04-15T03:58:49.433ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2336860567283387716 n_samples = 6 unit = oximeter
842025-04-15T03:58:50.610ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4604029511534947471 n_samples = 6 unit = oximeter
852025-04-15T03:58:50.615ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862025-04-15T03:58:50.626ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
872025-04-15T03:58:50.632ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882025-04-15T03:58:51.431ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892025-04-15T03:58:51.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
902025-04-15T03:58:51.447ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
912025-04-15T03:58:52.177ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
922025-04-15T03:58:52.188ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
932025-04-15T03:58:52.194ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
942025-04-15T03:58:52.748ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952025-04-15T03:58:52.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
962025-04-15T03:58:52.764ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
972025-04-15T03:58:54.230ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982025-04-15T03:58:54.241ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
992025-04-15T03:58:54.247ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1002025-04-15T03:58:54.974ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012025-04-15T03:58:54.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1022025-04-15T03:58:54.991ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1032025-04-15T03:58:56.202ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042025-04-15T03:58:56.212ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1052025-04-15T03:58:56.218ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1062025-04-15T03:58:57.028ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072025-04-15T03:58:57.039ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1082025-04-15T03:58:57.045ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1092025-04-15T03:58:58.207ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102025-04-15T03:58:58.217ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1112025-04-15T03:58:58.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1122025-04-15T03:58:58.737ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132025-04-15T03:58:58.748ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1142025-04-15T03:58:58.753ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1152025-04-15T03:58:59.436ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2336860567283387716 n_samples = 6 unit = oximeter
1162025-04-15T03:58:59.826ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172025-04-15T03:58:59.836ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1182025-04-15T03:58:59.842ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1192025-04-15T03:59:00.416ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4604029511534947471 n_samples = 6 unit = oximeter
1202025-04-15T03:59:00.669ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212025-04-15T03:59:00.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1222025-04-15T03:59:00.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232025-04-15T03:59:01.270ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242025-04-15T03:59:01.281ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1252025-04-15T03:59:01.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262025-04-15T03:59:02.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272025-04-15T03:59:02.736ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1282025-04-15T03:59:02.743ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1292025-04-15T03:59:03.924ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1302025-04-15T03:59:03.936ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1312025-04-15T03:59:03.942ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1322025-04-15T03:59:04.245ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1332025-04-15T03:59:04.247ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 220.108529ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:420 unit = producer-server
1342025-04-15T03:59:04.499ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1352025-04-15T03:59:05.881ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1362025-04-15T03:59:06.046ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1372025-04-15T03:59:06.088ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1382025-04-15T03:59:07.075ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1392025-04-15T03:59:07.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1402025-04-15T03:59:07.148ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1412025-04-15T03:59:07.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1422025-04-15T03:59:07.795ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1432025-04-15T03:59:07.804ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1442025-04-15T03:59:08.675ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1452025-04-15T03:59:08.688ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1462025-04-15T03:59:08.695ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1472025-04-15T03:59:09.266ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2336860567283387716 n_samples = 6 unit = oximeter
1482025-04-15T03:59:09.797ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-04-15T03:59:09.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1502025-04-15T03:59:09.830ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512025-04-15T03:59:10.444ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4604029511534947471 n_samples = 6 unit = oximeter
1522025-04-15T03:59:10.690ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532025-04-15T03:59:10.702ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1542025-04-15T03:59:10.707ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1552025-04-15T03:59:11.961ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562025-04-15T03:59:11.973ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1572025-04-15T03:59:11.979ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1582025-04-15T03:59:13.371ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592025-04-15T03:59:13.382ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1602025-04-15T03:59:13.388ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1612025-04-15T03:59:14.643ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1622025-04-15T03:59:15.242ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1632025-04-15T03:59:15.255ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1642025-04-15T03:59:16.183ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1652025-04-15T03:59:16.200ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1662025-04-15T03:59:16.209ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1672025-04-15T03:59:17.701ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682025-04-15T03:59:17.712ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1692025-04-15T03:59:17.717ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1702025-04-15T03:59:18.669ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712025-04-15T03:59:18.680ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1722025-04-15T03:59:18.686ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1732025-04-15T03:59:19.296ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2336860567283387716 n_samples = 6 unit = oximeter
1742025-04-15T03:59:19.543ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1752025-04-15T03:59:19.544ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1762025-04-15T03:59:19.550ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 479.206049ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:420 unit = producer-server
1772025-04-15T03:59:19.561ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1782025-04-15T03:59:19.585ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792025-04-15T03:59:20.063ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1802025-04-15T03:59:20.356ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812025-04-15T03:59:20.368ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1822025-04-15T03:59:20.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832025-04-15T03:59:20.474ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4604029511534947471 n_samples = 6 unit = oximeter
1842025-04-15T03:59:21.665ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1852025-04-15T03:59:21.676ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1862025-04-15T03:59:21.682ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1872025-04-15T03:59:22.475ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882025-04-15T03:59:22.488ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1892025-04-15T03:59:22.494ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1902025-04-15T03:59:23.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912025-04-15T03:59:23.212ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1922025-04-15T03:59:23.217ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932025-04-15T03:59:23.904ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942025-04-15T03:59:23.915ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1952025-04-15T03:59:23.921ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962025-04-15T03:59:25.349ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972025-04-15T03:59:25.364ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
1982025-04-15T03:59:25.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992025-04-15T03:59:26.115ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002025-04-15T03:59:26.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2012025-04-15T03:59:26.131ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022025-04-15T03:59:26.802ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032025-04-15T03:59:26.813ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2042025-04-15T03:59:26.819ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052025-04-15T03:59:27.705ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062025-04-15T03:59:27.720ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2072025-04-15T03:59:27.727ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082025-04-15T03:59:29.160ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092025-04-15T03:59:29.172ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2102025-04-15T03:59:29.178ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112025-04-15T03:59:29.300ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2336860567283387716 n_samples = 6 unit = oximeter
2122025-04-15T03:59:29.848ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132025-04-15T03:59:29.860ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2142025-04-15T03:59:29.866ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2152025-04-15T03:59:30.417ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162025-04-15T03:59:30.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2172025-04-15T03:59:30.440ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2182025-04-15T03:59:30.476ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4604029511534947471 n_samples = 6 unit = oximeter
2192025-04-15T03:59:31.837ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202025-04-15T03:59:31.850ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2212025-04-15T03:59:31.856ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2222025-04-15T03:59:32.653ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232025-04-15T03:59:32.666ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2242025-04-15T03:59:32.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2252025-04-15T03:59:34.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262025-04-15T03:59:34.145ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2272025-04-15T03:59:34.150ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2282025-04-15T03:59:35.063ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2292025-04-15T03:59:35.064ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 932.20249ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:420 unit = producer-server
2302025-04-15T03:59:35.103ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312025-04-15T03:59:35.115ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2322025-04-15T03:59:35.121ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332025-04-15T03:59:36.029ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2342025-04-15T03:59:36.627ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352025-04-15T03:59:36.639ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2362025-04-15T03:59:36.645ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2372025-04-15T03:59:37.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382025-04-15T03:59:37.858ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2392025-04-15T03:59:37.864ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2402025-04-15T03:59:38.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2412025-04-15T03:59:38.753ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2422025-04-15T03:59:38.759ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2432025-04-15T03:59:39.302ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2336860567283387716 n_samples = 6 unit = oximeter
2442025-04-15T03:59:39.730ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2452025-04-15T03:59:39.743ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2462025-04-15T03:59:39.749ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2472025-04-15T03:59:40.479ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4604029511534947471 n_samples = 6 unit = oximeter
2482025-04-15T03:59:40.893ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492025-04-15T03:59:40.905ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2502025-04-15T03:59:40.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512025-04-15T03:59:42.085ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522025-04-15T03:59:42.099ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2532025-04-15T03:59:42.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542025-04-15T03:59:43.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552025-04-15T03:59:43.317ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2562025-04-15T03:59:43.324ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572025-04-15T03:59:44.367ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582025-04-15T03:59:44.379ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2592025-04-15T03:59:44.384ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2602025-04-15T03:59:45.588ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612025-04-15T03:59:45.602ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2622025-04-15T03:59:45.608ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2632025-04-15T03:59:46.681ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642025-04-15T03:59:46.693ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2652025-04-15T03:59:46.698ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2662025-04-15T03:59:48.199ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672025-04-15T03:59:48.212ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2682025-04-15T03:59:48.217ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2692025-04-15T03:59:49.304ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2336860567283387716 n_samples = 6 unit = oximeter
2702025-04-15T03:59:49.533ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712025-04-15T03:59:49.546ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2722025-04-15T03:59:49.552ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2732025-04-15T03:59:50.486ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4604029511534947471 n_samples = 6 unit = oximeter
2742025-04-15T03:59:50.494ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752025-04-15T03:59:50.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2762025-04-15T03:59:50.514ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2772025-04-15T03:59:51.031ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2782025-04-15T03:59:51.032ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.661334182s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:420 unit = producer-server
2792025-04-15T03:59:51.840ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802025-04-15T03:59:51.852ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2812025-04-15T03:59:51.857ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822025-04-15T03:59:53.093ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832025-04-15T03:59:53.106ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2842025-04-15T03:59:53.112ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2852025-04-15T03:59:53.726ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2862025-04-15T03:59:53.912ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2872025-04-15T03:59:53.924ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2882025-04-15T03:59:53.930ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2892025-04-15T03:59:55.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2902025-04-15T03:59:55.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2912025-04-15T03:59:55.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2922025-04-15T03:59:56.549ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2932025-04-15T03:59:58.883ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2942025-04-15T03:59:59.330ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2336860567283387716 n_samples = 6 unit = oximeter
2952025-04-15T03:59:59.330ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962025-04-15T04:00:00.494ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4604029511534947471 n_samples = 6 unit = oximeter
2972025-04-15T04:00:00.619ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982025-04-15T04:00:00.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2441:7cff:fedc:100a]
2992025-04-15T04:00:00.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]