Max level shown:
1 [ Nov 17 01:43:08 Enabled. ]
2 [ Nov 17 01:43:08 Rereading configuration. ]
3 [ Nov 17 01:43:09 Rereading configuration. ]
4 [ Nov 17 01:43:20 Rereading configuration. ]
5 [ Nov 17 01:43:29 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
6 [ Nov 17 01:43:29 Method "start" exited with status 0. ]
72026-11-17T01:43:29.718ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-11-17T01:43:29.718ZERROtfportd: Failed to connect to dpd. Retrying...
92026-11-17T01:43:30.720ZINFOtfportd: connected to dpd running softnpu-a133c73e
102026-11-17T01:43:30.720ZINFOtfportd: running in sync-only mode
112026-11-17T01:43:30.721ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
122026-11-17T01:43:30.721ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
132026-11-17T01:43:30.721ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 852ee0b3-4245-4231-816b-58331877638a, sled_id: 7aeaa507-ce0f-4803-a37a-703c6ac3c6b3, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: b34b721c-c230-4903-9558-b74b029ec3ba, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
142026-11-17T01:43:30.721ZDEBGtfportd: created producer ID producer_id = 4c8f37a8-4e7a-4331-b749-9f44702a6682 unit = oximeter
152026-11-17T01:43:30.722ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 852ee0b3-4245-4231-816b-58331877638a, ), sled_id: Some( 7aeaa507-ce0f-4803-a37a-703c6ac3c6b3, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
162026-11-17T01:43:30.730ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-11-17T01:43:30.731ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ccb4:80ff:fe1f:1803->ce:b4:80:1f:18:03 interface = tfportrear0_0
182026-11-17T01:43:30.732ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::b061:74ff:fe52:e450->00:00:00:00:00:00 interface = tfportrear0_0
192026-11-17T01:43:30.733ZDEBGtfportd: registered DTrace probes unit = producer-server
202026-11-17T01:43:30.734ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:61121 method = GET path = /{producer_id} unit = producer-server versions = all
212026-11-17T01:43:30.734ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:61121 unit = producer-server
222026-11-17T01:43:30.734ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:61121 unit = producer-server
232026-11-17T01:43:30.734ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:61121 unit = producer-server
242026-11-17T01:43:30.734ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
252026-11-17T01:43:30.734ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
262026-11-17T01:43:30.735ZDEBGtfportd: starting producer registration task unit = producer-server
272026-11-17T01:43:30.735ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:61121 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 4c8f37a8-4e7a-4331-b749-9f44702a6682 unit = producer-server
282026-11-17T01:43:30.735ZINFOtfportd: created oximeter producer server unit = oximeter
292026-11-17T01:43:30.735ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
302026-11-17T01:43:30.735ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
312026-11-17T01:43:30.736ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
322026-11-17T01:43:30.736ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-11-17T01:43:04.008371944Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
332026-11-17T01:43:30.736ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 4130614009921464257 unit = oximeter
342026-11-17T01:43:30.736ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
352026-11-17T01:43:30.736ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("095787c5-85ec-4a47-969b-afb3681bdd56.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2dc16923-126b-4b0f-afc8-395cfcd64db6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 969, tv_nsec: 869482872 } }) unit = producer-server
362026-11-17T01:43:30.737ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
372026-11-17T01:43:30.740ZWARNtfportd: tfportqsfp0_0 has no addrs
382026-11-17T01:43:30.751ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
392026-11-17T01:43:31.767ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
402026-11-17T01:43:31.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
412026-11-17T01:43:31.774ZWARNtfportd: tfportqsfp0_0 has no addrs
422026-11-17T01:43:32.636ZINFOtfportd: removed stale NDP entry :fe80::b061:74ff:fe52:e450->00:00:00:00:00:00
432026-11-17T01:43:32.636ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::b061:74ff:fe52:e450->b2:61:74:52:e4:50 interface = tfportrear0_0
442026-11-17T01:43:32.953ZINFOtfportd: added new ARP entry entry = 10.151.2.174->ae:83:ba:c6:c5:dd interface = tfportqsfp0_0
452026-11-17T01:43:33.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
462026-11-17T01:43:33.225ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
472026-11-17T01:43:33.227ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
482026-11-17T01:43:33.228ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-11-17T01:43:33.229ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-11-17T01:43:04.008160170Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
502026-11-17T01:43:33.229ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 15881920288806370952 unit = oximeter
512026-11-17T01:43:33.229ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
522026-11-17T01:43:34.540ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
532026-11-17T01:43:34.546ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
542026-11-17T01:43:34.549ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
552026-11-17T01:43:35.090ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
562026-11-17T01:43:35.095ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
572026-11-17T01:43:35.098ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
582026-11-17T01:43:35.697ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
592026-11-17T01:43:35.702ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
602026-11-17T01:43:35.704ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
612026-11-17T01:43:36.454ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-11-17T01:43:36.458ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
632026-11-17T01:43:36.460ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
642026-11-17T01:43:37.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-11-17T01:43:37.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
662026-11-17T01:43:37.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
672026-11-17T01:43:38.600ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-11-17T01:43:38.605ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
692026-11-17T01:43:38.608ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
702026-11-17T01:43:40.036ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-11-17T01:43:40.040ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
722026-11-17T01:43:40.042ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
732026-11-17T01:43:40.649ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
742026-11-17T01:43:41.481ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752026-11-17T01:43:41.486ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
762026-11-17T01:43:41.488ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
772026-11-17T01:43:42.751ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-11-17T01:43:42.755ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
792026-11-17T01:43:42.757ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
802026-11-17T01:43:43.134ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15881920288806370952 n_samples = 6 unit = oximeter
812026-11-17T01:43:43.405ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
822026-11-17T01:43:43.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
832026-11-17T01:43:43.413ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
842026-11-17T01:43:44.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
852026-11-17T01:43:44.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
862026-11-17T01:43:44.231ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
872026-11-17T01:43:44.903ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-11-17T01:43:44.908ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
892026-11-17T01:43:44.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
902026-11-17T01:43:45.648ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
912026-11-17T01:43:45.649ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 15.01863896s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
922026-11-17T01:43:45.695ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932026-11-17T01:43:45.700ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
942026-11-17T01:43:45.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
952026-11-17T01:43:45.863ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("095787c5-85ec-4a47-969b-afb3681bdd56.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2dc16923-126b-4b0f-afc8-395cfcd64db6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 985, tv_nsec: 101601240 } }) unit = producer-server
962026-11-17T01:43:45.864ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
972026-11-17T01:43:45.871ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
982026-11-17T01:43:46.987ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
992026-11-17T01:43:46.991ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1002026-11-17T01:43:46.994ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1012026-11-17T01:43:48.299ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1022026-11-17T01:43:48.304ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1032026-11-17T01:43:48.311ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1042026-11-17T01:43:49.282ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1052026-11-17T01:43:49.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1062026-11-17T01:43:49.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1072026-11-17T01:43:50.277ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1082026-11-17T01:43:50.281ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1092026-11-17T01:43:50.284ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1102026-11-17T01:43:50.623ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
1112026-11-17T01:43:51.105ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-11-17T01:43:51.109ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1132026-11-17T01:43:51.111ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1142026-11-17T01:43:51.925ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-11-17T01:43:51.929ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1162026-11-17T01:43:51.931ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1172026-11-17T01:43:52.573ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-11-17T01:43:52.577ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1192026-11-17T01:43:52.580ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1202026-11-17T01:43:53.109ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15881920288806370952 n_samples = 6 unit = oximeter
1212026-11-17T01:43:53.386ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1222026-11-17T01:43:53.390ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1232026-11-17T01:43:53.393ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1242026-11-17T01:43:54.227ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-11-17T01:43:54.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1262026-11-17T01:43:54.234ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1272026-11-17T01:43:55.648ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-11-17T01:43:55.652ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1292026-11-17T01:43:55.655ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1302026-11-17T01:43:56.329ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-11-17T01:43:56.334ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1322026-11-17T01:43:56.336ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1332026-11-17T01:43:57.291ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-11-17T01:43:57.295ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1352026-11-17T01:43:57.298ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1362026-11-17T01:43:58.224ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-11-17T01:43:58.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1382026-11-17T01:43:58.231ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392026-11-17T01:43:59.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-11-17T01:43:59.205ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1412026-11-17T01:43:59.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1422026-11-17T01:44:00.597ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
1432026-11-17T01:44:00.602ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-11-17T01:44:00.607ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1452026-11-17T01:44:00.610ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1462026-11-17T01:44:00.831ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1472026-11-17T01:44:00.832ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 30.242401197s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1482026-11-17T01:44:01.248ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("095787c5-85ec-4a47-969b-afb3681bdd56.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2dc16923-126b-4b0f-afc8-395cfcd64db6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 527750129 } }) unit = producer-server
1492026-11-17T01:44:01.249ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1502026-11-17T01:44:01.255ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1512026-11-17T01:44:01.774ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-11-17T01:44:01.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1532026-11-17T01:44:01.780ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1542026-11-17T01:44:03.083ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15881920288806370952 n_samples = 6 unit = oximeter
1552026-11-17T01:44:03.235ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562026-11-17T01:44:03.239ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1572026-11-17T01:44:03.242ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1582026-11-17T01:44:03.784ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592026-11-17T01:44:03.789ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1602026-11-17T01:44:03.792ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1612026-11-17T01:44:05.206ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1622026-11-17T01:44:05.210ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1632026-11-17T01:44:05.213ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1642026-11-17T01:44:06.320ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1652026-11-17T01:44:06.324ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1662026-11-17T01:44:06.327ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1672026-11-17T01:44:06.957ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682026-11-17T01:44:06.961ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1692026-11-17T01:44:06.963ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1702026-11-17T01:44:08.227ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712026-11-17T01:44:08.231ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1722026-11-17T01:44:08.234ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1732026-11-17T01:44:09.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742026-11-17T01:44:09.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1752026-11-17T01:44:09.198ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1762026-11-17T01:44:10.308ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-11-17T01:44:10.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1782026-11-17T01:44:10.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1792026-11-17T01:44:10.572ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
1802026-11-17T01:44:11.450ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-11-17T01:44:11.454ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1822026-11-17T01:44:11.457ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1832026-11-17T01:44:12.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-11-17T01:44:12.059ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1852026-11-17T01:44:12.062ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1862026-11-17T01:44:13.057ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15881920288806370952 n_samples = 6 unit = oximeter
1872026-11-17T01:44:13.406ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882026-11-17T01:44:13.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1892026-11-17T01:44:13.412ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1902026-11-17T01:44:14.528ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-11-17T01:44:14.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1922026-11-17T01:44:14.536ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1932026-11-17T01:44:15.935ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-11-17T01:44:15.940ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
1952026-11-17T01:44:15.942ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1962026-11-17T01:44:16.216ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1972026-11-17T01:44:16.217ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 45.668970686s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1982026-11-17T01:44:16.643ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1992026-11-17T01:44:16.647ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2002026-11-17T01:44:16.650ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2012026-11-17T01:44:16.893ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("095787c5-85ec-4a47-969b-afb3681bdd56.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2dc16923-126b-4b0f-afc8-395cfcd64db6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 215303696 } }) unit = producer-server
2022026-11-17T01:44:16.894ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2032026-11-17T01:44:16.899ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2042026-11-17T01:44:17.603ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2052026-11-17T01:44:17.608ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2062026-11-17T01:44:17.610ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2072026-11-17T01:44:18.962ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2082026-11-17T01:44:18.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2092026-11-17T01:44:18.969ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2102026-11-17T01:44:20.123ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2112026-11-17T01:44:20.128ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2122026-11-17T01:44:20.130ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2132026-11-17T01:44:20.546ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
2142026-11-17T01:44:20.983ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-11-17T01:44:20.987ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2162026-11-17T01:44:20.990ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2172026-11-17T01:44:22.164ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182026-11-17T01:44:22.168ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2192026-11-17T01:44:22.170ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2202026-11-17T01:44:23.033ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15881920288806370952 n_samples = 6 unit = oximeter
2212026-11-17T01:44:23.509ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222026-11-17T01:44:23.514ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2232026-11-17T01:44:23.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2242026-11-17T01:44:24.046ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252026-11-17T01:44:24.051ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2262026-11-17T01:44:24.053ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2272026-11-17T01:44:24.992ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282026-11-17T01:44:24.997ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2292026-11-17T01:44:24.999ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2302026-11-17T01:44:25.644ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312026-11-17T01:44:25.648ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2322026-11-17T01:44:25.650ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2332026-11-17T01:44:26.172ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-11-17T01:44:26.177ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2352026-11-17T01:44:26.179ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2362026-11-17T01:44:27.106ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-11-17T01:44:27.110ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2382026-11-17T01:44:27.112ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2392026-11-17T01:44:28.074ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-11-17T01:44:28.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2412026-11-17T01:44:28.080ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2422026-11-17T01:44:29.432ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-11-17T01:44:29.437ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2442026-11-17T01:44:29.440ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2452026-11-17T01:44:30.289ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-11-17T01:44:30.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2472026-11-17T01:44:30.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2482026-11-17T01:44:30.521ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
2492026-11-17T01:44:30.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-11-17T01:44:30.863ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2512026-11-17T01:44:30.866ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2522026-11-17T01:44:31.860ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2532026-11-17T01:44:31.861ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 61.355534181s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2542026-11-17T01:44:32.153ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-11-17T01:44:32.157ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2562026-11-17T01:44:32.159ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2572026-11-17T01:44:32.891ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-11-17T01:44:32.895ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2592026-11-17T01:44:32.897ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2602026-11-17T01:44:33.007ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15881920288806370952 n_samples = 6 unit = oximeter
2612026-11-17T01:44:33.206ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("095787c5-85ec-4a47-969b-afb3681bdd56.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2dc16923-126b-4b0f-afc8-395cfcd64db6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1032, tv_nsec: 573052890 } }) unit = producer-server
2622026-11-17T01:44:33.207ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2632026-11-17T01:44:33.213ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2642026-11-17T01:44:34.240ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2652026-11-17T01:44:34.244ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2662026-11-17T01:44:34.247ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2672026-11-17T01:44:35.148ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-11-17T01:44:35.152ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2692026-11-17T01:44:35.155ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2702026-11-17T01:44:36.047ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712026-11-17T01:44:36.052ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2722026-11-17T01:44:36.054ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2732026-11-17T01:44:36.770ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-11-17T01:44:36.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2752026-11-17T01:44:36.781ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2762026-11-17T01:44:37.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-11-17T01:44:37.890ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2782026-11-17T01:44:37.892ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2792026-11-17T01:44:38.629ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-11-17T01:44:38.633ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2812026-11-17T01:44:38.635ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2822026-11-17T01:44:40.012ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-11-17T01:44:40.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2842026-11-17T01:44:40.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2852026-11-17T01:44:40.496ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
2862026-11-17T01:44:40.666ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2872026-11-17T01:44:40.670ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2882026-11-17T01:44:40.673ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2892026-11-17T01:44:41.891ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2902026-11-17T01:44:41.896ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2912026-11-17T01:44:41.898ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2922026-11-17T01:44:42.940ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2932026-11-17T01:44:42.944ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2942026-11-17T01:44:42.947ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2952026-11-17T01:44:42.982ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15881920288806370952 n_samples = 6 unit = oximeter
2962026-11-17T01:44:43.655ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972026-11-17T01:44:43.659ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
2982026-11-17T01:44:43.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2992026-11-17T01:44:44.897ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002026-11-17T01:44:44.901ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3012026-11-17T01:44:44.903ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3022026-11-17T01:44:46.261ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032026-11-17T01:44:46.265ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3042026-11-17T01:44:46.267ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3052026-11-17T01:44:47.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-11-17T01:44:47.307ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3072026-11-17T01:44:47.310ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3082026-11-17T01:44:48.173ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3092026-11-17T01:44:48.174ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 77.713306884s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3102026-11-17T01:44:48.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-11-17T01:44:48.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3122026-11-17T01:44:48.306ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3132026-11-17T01:44:49.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3142026-11-17T01:44:49.213ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3152026-11-17T01:44:49.215ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3162026-11-17T01:44:49.975ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3172026-11-17T01:44:49.980ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3182026-11-17T01:44:49.983ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3192026-11-17T01:44:50.471ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
3202026-11-17T01:44:51.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-11-17T01:44:51.214ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3222026-11-17T01:44:51.216ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3232026-11-17T01:44:52.280ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242026-11-17T01:44:52.284ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3252026-11-17T01:44:52.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3262026-11-17T01:44:52.957ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15881920288806370952 n_samples = 6 unit = oximeter
3272026-11-17T01:44:53.507ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("095787c5-85ec-4a47-969b-afb3681bdd56.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2dc16923-126b-4b0f-afc8-395cfcd64db6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bcc1f369-db23-4c86-b2ff-9c524640c008.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1052, tv_nsec: 928571786 } }) unit = producer-server
3282026-11-17T01:44:53.507ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3292026-11-17T01:44:53.513ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3302026-11-17T01:44:53.746ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3312026-11-17T01:44:53.749ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3322026-11-17T01:44:53.751ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3332026-11-17T01:44:55.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342026-11-17T01:44:55.160ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3352026-11-17T01:44:55.162ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3362026-11-17T01:44:55.957ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-11-17T01:44:55.961ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3382026-11-17T01:44:55.964ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3392026-11-17T01:44:56.651ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-11-17T01:44:56.655ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3412026-11-17T01:44:56.657ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3422026-11-17T01:44:57.293ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-11-17T01:44:57.298ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3442026-11-17T01:44:57.300ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3452026-11-17T01:44:58.095ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-11-17T01:44:58.099ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3472026-11-17T01:44:58.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3482026-11-17T01:44:59.318ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-11-17T01:44:59.323ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3502026-11-17T01:44:59.325ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3512026-11-17T01:45:00.446ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4130614009921464257 n_samples = 6 unit = oximeter
3522026-11-17T01:45:00.765ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3532026-11-17T01:45:00.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ccb4:80ff:fe1f:1803]
3542026-11-17T01:45:00.774ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]