Max level shown:
1 [ May 13 22:58:46 Enabled. ]
2 [ May 13 22:58:46 Rereading configuration. ]
3 [ May 13 22:58:46 Rereading configuration. ]
4 [ May 13 22:58:57 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ May 13 22:58:57 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-05-13T22:58:57.420ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-05-13T22:58:57.469ZINFOtfportd: connected to dpd running softnpu-0dcd325b
92025-05-13T22:58:57.470ZINFOtfportd: running in sync-only mode
102025-05-13T22:58:57.470ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-05-13T22:58:57.478ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-05-13T22:58:57.484ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( cbcab196-00d3-4647-a797-13b4e4ffe38c, ), sled_id: Some( 01664092-0c13-43dc-8d52-8ef175b1fec0, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142025-05-13T22:58:57.484ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-05-13T22:58:57.490ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::6cf2:30ff:fe85:28da->6e:f2:30:85:28:da interface = tfportrear0_0
162025-05-13T22:58:57.492ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172025-05-13T22:58:57.506ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
182025-05-13T22:58:57.517ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ May 13 22:58:58 Rereading configuration. ]
20 [ May 13 22:58:58 Executing refresh method (:kill). ]
21 [ May 13 22:58:58 Stopping because all processes in service exited. ]
22 [ May 13 22:58:58 Executing stop method (:kill). ]
23 [ May 13 22:58:58 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ May 13 22:58:58 Method "start" exited with status 0. ]
252025-05-13T22:58:58.046ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262025-05-13T22:58:58.085ZINFOtfportd: connected to dpd running softnpu-0dcd325b
272025-05-13T22:58:58.085ZINFOtfportd: running in sync-only mode
282025-05-13T22:58:58.086ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292025-05-13T22:58:58.092ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: cbcab196-00d3-4647-a797-13b4e4ffe38c, sled_id: 01664092-0c13-43dc-8d52-8ef175b1fec0, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 9ce99733-2666-468b-8344-d7c360b51ab7, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
302025-05-13T22:58:58.094ZDEBGtfportd: created producer ID producer_id = 56456637-2aa6-4310-a981-4a86f1fb07fb unit = oximeter
312025-05-13T22:58:58.094ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
322025-05-13T22:58:58.096ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( cbcab196-00d3-4647-a797-13b4e4ffe38c, ), sled_id: Some( 01664092-0c13-43dc-8d52-8ef175b1fec0, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
332025-05-13T22:58:58.102ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::6cf2:30ff:fe85:28da->6e:f2:30:85:28:da interface = tfportrear0_0
342025-05-13T22:58:58.102ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e8cf:fbff:feab:bd47->ea:cf:fb:ab:bd:47 interface = tfportrear0_0
352025-05-13T22:58:58.103ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
362025-05-13T22:58:58.107ZDEBGtfportd: registered DTrace probes unit = producer-server
372025-05-13T22:58:58.107ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:61498 method = GET path = /{producer_id} unit = producer-server versions = all
382025-05-13T22:58:58.107ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:61498 unit = producer-server
392025-05-13T22:58:58.107ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:61498 unit = producer-server
402025-05-13T22:58:58.107ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:61498 unit = producer-server
412025-05-13T22:58:58.107ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422025-05-13T22:58:58.108ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/internal-dns/resolver/src/resolver.rs:111 unit = producer-server
432025-05-13T22:58:58.108ZDEBGtfportd: starting producer registration task unit = producer-server
442025-05-13T22:58:58.108ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:61498 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 56456637-2aa6-4310-a981-4a86f1fb07fb unit = producer-server
452025-05-13T22:58:58.108ZINFOtfportd: created oximeter producer server unit = oximeter
462025-05-13T22:58:58.108ZDEBGtfportd (producer-registration-task): registering / renewing oximeter producer lease with Nexus unit = producer-server
472025-05-13T22:58:58.115ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
482025-05-13T22:58:58.119ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-05-13T22:58:41.186616137Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
492025-05-13T22:58:58.119ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 6863669711476590575 unit = oximeter
502025-05-13T22:58:58.119ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
512025-05-13T22:58:58.122ZWARNtfportd: tfportqsfp0_0 has no addrs
522025-05-13T22:58:59.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
532025-05-13T22:58:59.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
542025-05-13T22:58:59.233ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
552025-05-13T22:58:59.234ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-05-13T22:58:41.186476552Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
562025-05-13T22:58:59.234ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 14353862300797271634 unit = oximeter
572025-05-13T22:58:59.234ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
582025-05-13T22:58:59.277ZINFOtfportd: added new ARP entry entry = 10.151.2.174->6a:03:20:bd:3a:3d interface = tfportqsfp0_0
592025-05-13T22:59:00.396ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
602025-05-13T22:59:00.503ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
612025-05-13T22:59:00.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
622025-05-13T22:59:01.217ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
632025-05-13T22:59:01.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
642025-05-13T22:59:01.234ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
652025-05-13T22:59:02.077ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662025-05-13T22:59:02.090ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
672025-05-13T22:59:02.096ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
682025-05-13T22:59:03.574ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692025-05-13T22:59:03.585ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
702025-05-13T22:59:03.591ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
712025-05-13T22:59:04.762ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
722025-05-13T22:59:04.775ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
732025-05-13T22:59:04.781ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
742025-05-13T22:59:06.117ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752025-05-13T22:59:06.128ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
762025-05-13T22:59:06.134ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
772025-05-13T22:59:07.088ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782025-05-13T22:59:07.100ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
792025-05-13T22:59:07.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
802025-05-13T22:59:08.111ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("049171a7-8aff-47c3-bb96-a4154a077926.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6f1779bd-e1a8-42f2-ab98-d5ed269e565e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ddc040c8-99a0-469b-88c2-2773cfc2e24b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ddc040c8-99a0-469b-88c2-2773cfc2e24b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::a))) }], valid_until: Instant { tv_sec: 832, tv_nsec: 805438912 } }) unit = producer-server
812025-05-13T22:59:08.112ZDEBGtfportd (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221 unit = producer-server
822025-05-13T22:59:08.143ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
832025-05-13T22:59:08.146ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6863669711476590575 n_samples = 6 unit = oximeter
842025-05-13T22:59:08.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
852025-05-13T22:59:08.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
862025-05-13T22:59:08.534ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
872025-05-13T22:59:09.237ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14353862300797271634 n_samples = 6 unit = oximeter
882025-05-13T22:59:09.826ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892025-05-13T22:59:09.837ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
902025-05-13T22:59:09.843ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
912025-05-13T22:59:10.617ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
922025-05-13T22:59:10.628ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
932025-05-13T22:59:10.633ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
942025-05-13T22:59:11.942ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952025-05-13T22:59:11.952ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
962025-05-13T22:59:11.957ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
972025-05-13T22:59:13.319ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982025-05-13T22:59:13.330ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
992025-05-13T22:59:13.335ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1002025-05-13T22:59:14.693ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012025-05-13T22:59:14.704ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1022025-05-13T22:59:14.709ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1032025-05-13T22:59:16.190ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042025-05-13T22:59:16.200ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1052025-05-13T22:59:16.206ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1062025-05-13T22:59:17.704ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072025-05-13T22:59:17.714ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1082025-05-13T22:59:17.719ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1092025-05-13T22:59:18.148ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6863669711476590575 n_samples = 6 unit = oximeter
1102025-05-13T22:59:18.459ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1112025-05-13T22:59:18.470ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1122025-05-13T22:59:18.476ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1132025-05-13T22:59:19.240ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14353862300797271634 n_samples = 6 unit = oximeter
1142025-05-13T22:59:19.260ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152025-05-13T22:59:19.271ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1162025-05-13T22:59:19.277ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1172025-05-13T22:59:21.272ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182025-05-13T22:59:21.283ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1192025-05-13T22:59:21.288ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1202025-05-13T22:59:21.980ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212025-05-13T22:59:21.991ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1222025-05-13T22:59:21.996ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1232025-05-13T22:59:22.941ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242025-05-13T22:59:22.952ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1252025-05-13T22:59:22.958ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1262025-05-13T22:59:23.663ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272025-05-13T22:59:23.674ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1282025-05-13T22:59:23.680ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1292025-05-13T22:59:23.681ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 144.665841ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:420 unit = producer-server
1302025-05-13T22:59:23.681ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1312025-05-13T22:59:23.856ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1322025-05-13T22:59:24.763ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1332025-05-13T22:59:24.775ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1342025-05-13T22:59:24.781ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1352025-05-13T22:59:25.358ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1362025-05-13T22:59:25.370ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1372025-05-13T22:59:25.375ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1382025-05-13T22:59:26.748ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1392025-05-13T22:59:26.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1402025-05-13T22:59:26.765ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1412025-05-13T22:59:27.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1422025-05-13T22:59:27.316ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1432025-05-13T22:59:27.321ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1442025-05-13T22:59:28.219ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1452025-05-13T22:59:28.230ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1462025-05-13T22:59:28.236ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1472025-05-13T22:59:28.698ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6863669711476590575 n_samples = 6 unit = oximeter
1482025-05-13T22:59:29.327ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-05-13T22:59:29.338ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1502025-05-13T22:59:29.344ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512025-05-13T22:59:29.793ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14353862300797271634 n_samples = 6 unit = oximeter
1522025-05-13T22:59:30.745ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532025-05-13T22:59:30.756ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1542025-05-13T22:59:30.762ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1552025-05-13T22:59:31.574ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562025-05-13T22:59:31.584ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1572025-05-13T22:59:31.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1582025-05-13T22:59:32.938ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592025-05-13T22:59:32.949ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1602025-05-13T22:59:32.954ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1612025-05-13T22:59:34.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1622025-05-13T22:59:34.040ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1632025-05-13T22:59:34.045ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1642025-05-13T22:59:34.724ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1652025-05-13T22:59:34.735ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1662025-05-13T22:59:34.741ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1672025-05-13T22:59:35.406ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682025-05-13T22:59:35.417ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1692025-05-13T22:59:35.423ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1702025-05-13T22:59:35.946ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712025-05-13T22:59:35.958ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1722025-05-13T22:59:35.963ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1732025-05-13T22:59:37.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742025-05-13T22:59:37.355ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1752025-05-13T22:59:37.359ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1762025-05-13T22:59:38.106ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772025-05-13T22:59:38.118ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1782025-05-13T22:59:38.123ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1792025-05-13T22:59:38.728ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6863669711476590575 n_samples = 6 unit = oximeter
1802025-05-13T22:59:38.898ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1812025-05-13T22:59:38.899ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 453.136789ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:420 unit = producer-server
1822025-05-13T22:59:39.153ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832025-05-13T22:59:39.164ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1842025-05-13T22:59:39.170ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1852025-05-13T22:59:39.384ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1862025-05-13T22:59:39.821ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14353862300797271634 n_samples = 6 unit = oximeter
1872025-05-13T22:59:40.631ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882025-05-13T22:59:40.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1892025-05-13T22:59:40.648ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1902025-05-13T22:59:42.110ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912025-05-13T22:59:42.121ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1922025-05-13T22:59:42.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1932025-05-13T22:59:43.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942025-05-13T22:59:43.231ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1952025-05-13T22:59:43.237ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1962025-05-13T22:59:43.868ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972025-05-13T22:59:43.879ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
1982025-05-13T22:59:43.884ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1992025-05-13T22:59:45.189ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002025-05-13T22:59:45.201ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2012025-05-13T22:59:45.206ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2022025-05-13T22:59:46.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032025-05-13T22:59:46.574ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2042025-05-13T22:59:46.579ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2052025-05-13T22:59:47.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062025-05-13T22:59:47.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2072025-05-13T22:59:47.356ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2082025-05-13T22:59:48.080ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092025-05-13T22:59:48.091ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2102025-05-13T22:59:48.096ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2112025-05-13T22:59:48.758ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6863669711476590575 n_samples = 6 unit = oximeter
2122025-05-13T22:59:49.060ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132025-05-13T22:59:49.071ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2142025-05-13T22:59:49.077ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2152025-05-13T22:59:49.850ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14353862300797271634 n_samples = 6 unit = oximeter
2162025-05-13T22:59:49.850ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172025-05-13T22:59:49.861ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2182025-05-13T22:59:49.866ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2192025-05-13T22:59:51.225ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202025-05-13T22:59:51.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2212025-05-13T22:59:51.242ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2222025-05-13T22:59:51.829ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232025-05-13T22:59:51.840ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2242025-05-13T22:59:51.845ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2252025-05-13T22:59:52.842ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262025-05-13T22:59:52.853ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2272025-05-13T22:59:52.859ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2282025-05-13T22:59:53.708ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292025-05-13T22:59:53.720ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2302025-05-13T22:59:53.726ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2312025-05-13T22:59:54.425ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2322025-05-13T22:59:54.426ZWARNtfportd (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 846.770943ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e2f9776/oximeter/producer/src/lib.rs:420 unit = producer-server
2332025-05-13T22:59:55.145ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342025-05-13T22:59:55.156ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2352025-05-13T22:59:55.162ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2362025-05-13T22:59:55.308ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2372025-05-13T22:59:55.749ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382025-05-13T22:59:55.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2392025-05-13T22:59:55.766ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2402025-05-13T22:59:56.867ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2412025-05-13T22:59:56.878ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2422025-05-13T22:59:56.883ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2432025-05-13T22:59:58.368ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2442025-05-13T22:59:58.379ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2452025-05-13T22:59:58.384ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2462025-05-13T22:59:58.786ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6863669711476590575 n_samples = 6 unit = oximeter
2472025-05-13T22:59:59.633ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2482025-05-13T22:59:59.644ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2492025-05-13T22:59:59.650ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2502025-05-13T22:59:59.880ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14353862300797271634 n_samples = 6 unit = oximeter
2512025-05-13T23:00:01.143ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522025-05-13T23:00:01.156ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::6cf2:30ff:fe85:28da]
2532025-05-13T23:00:01.162ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]