Max level shown:
1 [ Apr 7 18:41:09 Enabled. ]
2 [ Apr 7 18:41:09 Rereading configuration. ]
3 [ Apr 7 18:41:10 Rereading configuration. ]
4 [ Apr 7 18:41:31 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Apr 7 18:41:31 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-04-07T18:41:31.778ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-04-07T18:41:31.779ZINFOtfportd: connected to dpd running softnpu-44a949c9
92026-04-07T18:41:31.779ZINFOtfportd: running in sync-only mode
102026-04-07T18:41:31.780ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-04-07T18:41:31.782ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-04-07T18:41:31.783ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 9f500aa8-d790-4435-bfe6-703d34750132, ), sled_id: Some( 1a03e04c-a2c0-49d9-8885-91c473ae1851, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-04-07T18:41:31.783ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-04-07T18:41:31.787ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::cc27:89ff:fe40:bc36->ce:27:89:40:bc:36 interface = tfportrear0_0
162026-04-07T18:41:31.787ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ce:83ff:fe3e:ffd0->02:ce:83:3e:ff:d0 interface = tfportrear0_0
172026-04-07T18:41:31.789ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
182026-04-07T18:41:31.794ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
192026-04-07T18:41:31.798ZWARNtfportd: tfportqsfp0_0 has no addrs
20 [ Apr 7 18:41:32 Rereading configuration. ]
21 [ Apr 7 18:41:32 Executing refresh method (:kill). ]
22 [ Apr 7 18:41:32 Stopping because all processes in service exited. ]
23 [ Apr 7 18:41:32 Executing stop method (:kill). ]
24 [ Apr 7 18:41:32 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ Apr 7 18:41:32 Method "start" exited with status 0. ]
262026-04-07T18:41:32.342ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272026-04-07T18:41:32.343ZINFOtfportd: connected to dpd running softnpu-44a949c9
282026-04-07T18:41:32.343ZINFOtfportd: running in sync-only mode
292026-04-07T18:41:32.343ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302026-04-07T18:41:32.345ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312026-04-07T18:41:32.345ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 9f500aa8-d790-4435-bfe6-703d34750132, sled_id: 1a03e04c-a2c0-49d9-8885-91c473ae1851, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 441210d4-7ef9-49ae-b8ae-9d04663cfec3, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322026-04-07T18:41:32.345ZDEBGtfportd: created producer ID producer_id = c141fa30-0ba9-4442-8fcd-7cfd21e7e7a0 unit = oximeter
332026-04-07T18:41:32.346ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 9f500aa8-d790-4435-bfe6-703d34750132, ), sled_id: Some( 1a03e04c-a2c0-49d9-8885-91c473ae1851, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
342026-04-07T18:41:32.352ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352026-04-07T18:41:32.353ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::cc27:89ff:fe40:bc36->ce:27:89:40:bc:36 interface = tfportrear0_0
362026-04-07T18:41:32.354ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ce:83ff:fe3e:ffd0->02:ce:83:3e:ff:d0 interface = tfportrear0_0
372026-04-07T18:41:32.355ZDEBGtfportd: registered DTrace probes unit = producer-server
382026-04-07T18:41:32.356ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:51937 method = GET path = /{producer_id} unit = producer-server versions = all
392026-04-07T18:41:32.356ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:51937 unit = producer-server
402026-04-07T18:41:32.356ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:51937 unit = producer-server
412026-04-07T18:41:32.356ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:51937 unit = producer-server
422026-04-07T18:41:32.356ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-04-07T18:41:32.356ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442026-04-07T18:41:32.357ZDEBGtfportd: starting producer registration task unit = producer-server
452026-04-07T18:41:32.357ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:51937 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = c141fa30-0ba9-4442-8fcd-7cfd21e7e7a0 unit = producer-server
462026-04-07T18:41:32.357ZINFOtfportd: created oximeter producer server unit = oximeter
472026-04-07T18:41:32.357ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-04-07T18:41:32.358ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
492026-04-07T18:41:32.358ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 1.17664ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
502026-04-07T18:41:32.358ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
512026-04-07T18:41:32.359ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-04-07T18:41:05.688438419Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
522026-04-07T18:41:32.359ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 9659655969040896701 unit = oximeter
532026-04-07T18:41:32.359ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
542026-04-07T18:41:32.361ZWARNtfportd: tfportqsfp0_0 has no addrs
552026-04-07T18:41:32.585ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("189420b8-8e87-4144-950f-5019d1146431.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9654aa96-0cfa-4537-ad68-c75faa53f0da.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 668, tv_nsec: 67042194 } }) unit = producer-server
562026-04-07T18:41:32.585ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
572026-04-07T18:41:32.626ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
582026-04-07T18:41:33.233ZINFOtfportd: added new ARP entry entry = 10.151.1.174->66:61:21:1f:a8:23 interface = tfportqsfp0_0
592026-04-07T18:41:33.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
602026-04-07T18:41:33.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
612026-04-07T18:41:33.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
622026-04-07T18:41:33.573ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
632026-04-07T18:41:33.575ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-04-07T18:41:05.688289855Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
642026-04-07T18:41:33.575ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 12882058990794922576 unit = oximeter
652026-04-07T18:41:33.575ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
662026-04-07T18:41:34.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
672026-04-07T18:41:34.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
682026-04-07T18:41:34.521ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
692026-04-07T18:41:35.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
702026-04-07T18:41:35.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
712026-04-07T18:41:35.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
722026-04-07T18:41:36.260ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
732026-04-07T18:41:36.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
742026-04-07T18:41:36.268ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
752026-04-07T18:41:37.110ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
762026-04-07T18:41:37.114ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
772026-04-07T18:41:37.117ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
782026-04-07T18:41:38.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
792026-04-07T18:41:38.467ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
802026-04-07T18:41:38.470ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
812026-04-07T18:41:39.792ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
822026-04-07T18:41:39.795ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
832026-04-07T18:41:39.798ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
842026-04-07T18:41:40.797ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
852026-04-07T18:41:40.802ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
862026-04-07T18:41:40.805ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
872026-04-07T18:41:41.352ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-04-07T18:41:41.357ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
892026-04-07T18:41:41.359ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
902026-04-07T18:41:41.963ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912026-04-07T18:41:41.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
922026-04-07T18:41:41.970ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932026-04-07T18:41:42.364ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
942026-04-07T18:41:43.432ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952026-04-07T18:41:43.437ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
962026-04-07T18:41:43.439ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
972026-04-07T18:41:43.578ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
982026-04-07T18:41:44.297ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
992026-04-07T18:41:44.301ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1002026-04-07T18:41:44.304ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1012026-04-07T18:41:45.067ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1022026-04-07T18:41:45.073ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1032026-04-07T18:41:45.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1042026-04-07T18:41:46.453ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1052026-04-07T18:41:46.458ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1062026-04-07T18:41:46.461ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1072026-04-07T18:41:47.489ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1082026-04-07T18:41:47.490ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 15.271781603s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1092026-04-07T18:41:47.634ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-04-07T18:41:47.638ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1112026-04-07T18:41:47.641ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1122026-04-07T18:41:48.166ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("189420b8-8e87-4144-950f-5019d1146431.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9654aa96-0cfa-4537-ad68-c75faa53f0da.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 683, tv_nsec: 788420947 } }) unit = producer-server
1132026-04-07T18:41:48.166ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1142026-04-07T18:41:48.199ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1152026-04-07T18:41:48.199ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162026-04-07T18:41:48.205ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1172026-04-07T18:41:48.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1182026-04-07T18:41:49.334ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192026-04-07T18:41:49.339ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1202026-04-07T18:41:49.341ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1212026-04-07T18:41:50.118ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1222026-04-07T18:41:50.122ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1232026-04-07T18:41:50.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1242026-04-07T18:41:50.764ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-04-07T18:41:50.768ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1262026-04-07T18:41:50.771ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272026-04-07T18:41:51.705ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-04-07T18:41:51.709ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1292026-04-07T18:41:51.713ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-04-07T18:41:52.216ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
1312026-04-07T18:41:52.601ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1322026-04-07T18:41:52.606ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1332026-04-07T18:41:52.608ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1342026-04-07T18:41:53.330ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-04-07T18:41:53.335ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1362026-04-07T18:41:53.337ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372026-04-07T18:41:53.425ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
1382026-04-07T18:41:54.620ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1392026-04-07T18:41:54.625ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1402026-04-07T18:41:54.628ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1412026-04-07T18:41:55.656ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1422026-04-07T18:41:55.661ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1432026-04-07T18:41:55.664ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1442026-04-07T18:41:56.173ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1452026-04-07T18:41:56.178ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1462026-04-07T18:41:56.181ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1472026-04-07T18:41:57.345ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1482026-04-07T18:41:57.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1492026-04-07T18:41:57.353ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1502026-04-07T18:41:58.570ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1512026-04-07T18:41:58.574ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1522026-04-07T18:41:58.577ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1532026-04-07T18:41:59.964ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1542026-04-07T18:41:59.969ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1552026-04-07T18:41:59.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1562026-04-07T18:42:01.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572026-04-07T18:42:01.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1582026-04-07T18:42:01.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1592026-04-07T18:42:02.191ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
1602026-04-07T18:42:02.339ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612026-04-07T18:42:02.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1622026-04-07T18:42:02.347ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1632026-04-07T18:42:03.159ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1642026-04-07T18:42:03.160ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 30.984444733s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1652026-04-07T18:42:03.259ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662026-04-07T18:42:03.264ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1672026-04-07T18:42:03.267ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1682026-04-07T18:42:03.400ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
1692026-04-07T18:42:04.003ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1702026-04-07T18:42:04.007ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1712026-04-07T18:42:04.010ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1722026-04-07T18:42:04.514ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("189420b8-8e87-4144-950f-5019d1146431.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9654aa96-0cfa-4537-ad68-c75faa53f0da.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 700, tv_nsec: 180937777 } }) unit = producer-server
1732026-04-07T18:42:04.515ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1742026-04-07T18:42:04.546ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1752026-04-07T18:42:04.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1762026-04-07T18:42:04.746ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1772026-04-07T18:42:04.749ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1782026-04-07T18:42:05.941ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1792026-04-07T18:42:05.948ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1802026-04-07T18:42:05.951ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1812026-04-07T18:42:06.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1822026-04-07T18:42:06.792ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1832026-04-07T18:42:06.794ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1842026-04-07T18:42:07.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1852026-04-07T18:42:07.664ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1862026-04-07T18:42:07.667ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1872026-04-07T18:42:09.064ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882026-04-07T18:42:09.068ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1892026-04-07T18:42:09.071ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1902026-04-07T18:42:09.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-04-07T18:42:09.914ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1922026-04-07T18:42:09.916ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932026-04-07T18:42:10.869ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-04-07T18:42:10.874ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1952026-04-07T18:42:10.877ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-04-07T18:42:11.515ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-04-07T18:42:11.520ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
1982026-04-07T18:42:11.523ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-04-07T18:42:12.166ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
2002026-04-07T18:42:12.536ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012026-04-07T18:42:12.540ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2022026-04-07T18:42:12.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2032026-04-07T18:42:13.374ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
2042026-04-07T18:42:13.492ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2052026-04-07T18:42:13.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2062026-04-07T18:42:13.499ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2072026-04-07T18:42:14.712ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2082026-04-07T18:42:14.717ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2092026-04-07T18:42:14.719ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2102026-04-07T18:42:15.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2112026-04-07T18:42:15.828ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2122026-04-07T18:42:15.831ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2132026-04-07T18:42:16.613ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2142026-04-07T18:42:16.618ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2152026-04-07T18:42:16.621ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2162026-04-07T18:42:17.577ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172026-04-07T18:42:17.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2182026-04-07T18:42:17.585ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2192026-04-07T18:42:18.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202026-04-07T18:42:18.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2212026-04-07T18:42:18.347ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2222026-04-07T18:42:19.147ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-04-07T18:42:19.152ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2242026-04-07T18:42:19.154ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2252026-04-07T18:42:19.507ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2262026-04-07T18:42:19.508ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 47.376991093s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2272026-04-07T18:42:20.257ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282026-04-07T18:42:20.261ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2292026-04-07T18:42:20.264ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302026-04-07T18:42:21.531ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312026-04-07T18:42:21.535ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2322026-04-07T18:42:21.538ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332026-04-07T18:42:21.711ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("189420b8-8e87-4144-950f-5019d1146431.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9654aa96-0cfa-4537-ad68-c75faa53f0da.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 717, tv_nsec: 425198369 } }) unit = producer-server
2342026-04-07T18:42:21.712ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2352026-04-07T18:42:21.744ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2362026-04-07T18:42:22.141ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
2372026-04-07T18:42:22.536ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382026-04-07T18:42:22.540ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2392026-04-07T18:42:22.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2402026-04-07T18:42:23.094ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2412026-04-07T18:42:23.098ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2422026-04-07T18:42:23.100ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2432026-04-07T18:42:23.348ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
2442026-04-07T18:42:24.199ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2452026-04-07T18:42:24.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2462026-04-07T18:42:24.206ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2472026-04-07T18:42:25.194ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2482026-04-07T18:42:25.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2492026-04-07T18:42:25.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2502026-04-07T18:42:26.124ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2512026-04-07T18:42:26.130ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2522026-04-07T18:42:26.138ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2532026-04-07T18:42:27.144ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2542026-04-07T18:42:27.149ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2552026-04-07T18:42:27.152ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2562026-04-07T18:42:28.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2572026-04-07T18:42:28.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2582026-04-07T18:42:28.344ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2592026-04-07T18:42:29.354ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602026-04-07T18:42:29.358ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2612026-04-07T18:42:29.360ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622026-04-07T18:42:30.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632026-04-07T18:42:30.783ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2642026-04-07T18:42:30.786ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652026-04-07T18:42:31.959ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662026-04-07T18:42:31.964ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2672026-04-07T18:42:31.967ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682026-04-07T18:42:32.115ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
2692026-04-07T18:42:32.841ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702026-04-07T18:42:32.844ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2712026-04-07T18:42:32.847ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2722026-04-07T18:42:33.323ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
2732026-04-07T18:42:33.652ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-04-07T18:42:33.657ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2752026-04-07T18:42:33.660ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762026-04-07T18:42:34.789ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-04-07T18:42:34.793ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2782026-04-07T18:42:34.796ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792026-04-07T18:42:35.822ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-04-07T18:42:35.827ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2812026-04-07T18:42:35.830ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-04-07T18:42:36.705ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2832026-04-07T18:42:36.706ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 64.621709627s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2842026-04-07T18:42:37.321ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2852026-04-07T18:42:37.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2862026-04-07T18:42:37.328ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2872026-04-07T18:42:38.591ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2882026-04-07T18:42:38.596ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2892026-04-07T18:42:38.599ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2902026-04-07T18:42:39.474ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912026-04-07T18:42:39.479ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2922026-04-07T18:42:39.482ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2932026-04-07T18:42:40.492ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("189420b8-8e87-4144-950f-5019d1146431.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9654aa96-0cfa-4537-ad68-c75faa53f0da.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 736, tv_nsec: 256685259 } }) unit = producer-server
2942026-04-07T18:42:40.492ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2952026-04-07T18:42:40.526ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2962026-04-07T18:42:40.605ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972026-04-07T18:42:40.610ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
2982026-04-07T18:42:40.612ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2992026-04-07T18:42:41.916ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002026-04-07T18:42:41.921ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3012026-04-07T18:42:41.924ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3022026-04-07T18:42:42.091ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
3032026-04-07T18:42:42.656ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3042026-04-07T18:42:42.662ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3052026-04-07T18:42:42.665ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3062026-04-07T18:42:43.297ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
3072026-04-07T18:42:43.917ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3082026-04-07T18:42:43.921ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3092026-04-07T18:42:43.923ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3102026-04-07T18:42:45.164ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-04-07T18:42:45.169ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3122026-04-07T18:42:45.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132026-04-07T18:42:45.926ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3142026-04-07T18:42:45.930ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3152026-04-07T18:42:45.933ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3162026-04-07T18:42:46.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3172026-04-07T18:42:46.896ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3182026-04-07T18:42:46.899ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3192026-04-07T18:42:47.692ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3202026-04-07T18:42:47.696ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3212026-04-07T18:42:47.699ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3222026-04-07T18:42:48.774ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3232026-04-07T18:42:48.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3242026-04-07T18:42:48.781ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3252026-04-07T18:42:49.702ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262026-04-07T18:42:49.707ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3272026-04-07T18:42:49.709ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3282026-04-07T18:42:50.469ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292026-04-07T18:42:50.474ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3302026-04-07T18:42:50.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3312026-04-07T18:42:51.620ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-04-07T18:42:51.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3332026-04-07T18:42:51.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342026-04-07T18:42:52.065ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
3352026-04-07T18:42:52.865ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3362026-04-07T18:42:52.869ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3372026-04-07T18:42:52.872ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3382026-04-07T18:42:53.272ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
3392026-04-07T18:42:54.164ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-04-07T18:42:54.169ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3412026-04-07T18:42:54.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-04-07T18:42:55.487ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3432026-04-07T18:42:55.489ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 83.455387024s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3442026-04-07T18:42:55.532ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452026-04-07T18:42:55.537ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3462026-04-07T18:42:55.539ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3472026-04-07T18:42:56.950ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482026-04-07T18:42:56.954ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3492026-04-07T18:42:56.958ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502026-04-07T18:42:57.828ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512026-04-07T18:42:57.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3522026-04-07T18:42:57.835ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532026-04-07T18:42:59.043ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542026-04-07T18:42:59.047ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3552026-04-07T18:42:59.050ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3562026-04-07T18:43:00.259ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-04-07T18:43:00.263ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3582026-04-07T18:43:00.266ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3592026-04-07T18:43:00.845ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("189420b8-8e87-4144-950f-5019d1146431.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9654aa96-0cfa-4537-ad68-c75faa53f0da.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 756, tv_nsec: 665414251 } }) unit = producer-server
3602026-04-07T18:43:00.846ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3612026-04-07T18:43:00.878ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3622026-04-07T18:43:01.312ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-04-07T18:43:01.316ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3642026-04-07T18:43:01.319ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652026-04-07T18:43:02.040ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
3662026-04-07T18:43:02.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-04-07T18:43:02.812ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3682026-04-07T18:43:02.815ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3692026-04-07T18:43:03.247ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
3702026-04-07T18:43:03.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712026-04-07T18:43:03.811ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3722026-04-07T18:43:03.814ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3732026-04-07T18:43:04.373ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3742026-04-07T18:43:04.377ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3752026-04-07T18:43:04.380ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3762026-04-07T18:43:05.508ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3772026-04-07T18:43:05.513ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3782026-04-07T18:43:05.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3792026-04-07T18:43:06.622ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802026-04-07T18:43:06.625ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3812026-04-07T18:43:06.628ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822026-04-07T18:43:08.007ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832026-04-07T18:43:08.012ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3842026-04-07T18:43:08.015ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3852026-04-07T18:43:08.908ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862026-04-07T18:43:08.912ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3872026-04-07T18:43:08.915ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3882026-04-07T18:43:09.654ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3892026-04-07T18:43:09.659ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3902026-04-07T18:43:09.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3912026-04-07T18:43:10.509ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922026-04-07T18:43:10.513ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3932026-04-07T18:43:10.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3942026-04-07T18:43:11.813ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952026-04-07T18:43:11.817ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
3962026-04-07T18:43:11.820ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3972026-04-07T18:43:12.015ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
3982026-04-07T18:43:12.539ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-04-07T18:43:12.544ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4002026-04-07T18:43:12.547ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012026-04-07T18:43:13.222ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
4022026-04-07T18:43:13.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4032026-04-07T18:43:13.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4042026-04-07T18:43:13.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4052026-04-07T18:43:14.791ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-04-07T18:43:14.795ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4072026-04-07T18:43:14.797ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4082026-04-07T18:43:15.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092026-04-07T18:43:15.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4102026-04-07T18:43:15.510ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4112026-04-07T18:43:15.837ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4122026-04-07T18:43:15.839ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 103.860420992s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4132026-04-07T18:43:16.284ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142026-04-07T18:43:16.289ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4152026-04-07T18:43:16.292ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162026-04-07T18:43:17.573ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172026-04-07T18:43:17.578ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4182026-04-07T18:43:17.581ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4192026-04-07T18:43:18.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202026-04-07T18:43:18.392ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4212026-04-07T18:43:18.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4222026-04-07T18:43:18.974ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4232026-04-07T18:43:18.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4242026-04-07T18:43:18.981ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4252026-04-07T18:43:20.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4262026-04-07T18:43:20.455ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4272026-04-07T18:43:20.458ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4282026-04-07T18:43:21.481ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4292026-04-07T18:43:21.486ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4302026-04-07T18:43:21.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4312026-04-07T18:43:21.990ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
4322026-04-07T18:43:22.425ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-04-07T18:43:22.429ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4342026-04-07T18:43:22.432ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4352026-04-07T18:43:23.197ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
4362026-04-07T18:43:23.509ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372026-04-07T18:43:23.514ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4382026-04-07T18:43:23.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4392026-04-07T18:43:25.005ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-04-07T18:43:25.009ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4412026-04-07T18:43:25.012ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4422026-04-07T18:43:26.427ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4432026-04-07T18:43:26.432ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4442026-04-07T18:43:26.435ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4452026-04-07T18:43:27.097ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462026-04-07T18:43:27.101ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4472026-04-07T18:43:27.104ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4482026-04-07T18:43:27.997ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4492026-04-07T18:43:28.002ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4502026-04-07T18:43:28.005ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4512026-04-07T18:43:29.179ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4522026-04-07T18:43:29.185ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4532026-04-07T18:43:29.188ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4542026-04-07T18:43:30.477ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4552026-04-07T18:43:30.481ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4562026-04-07T18:43:30.484ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4572026-04-07T18:43:31.340ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("189420b8-8e87-4144-950f-5019d1146431.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9654aa96-0cfa-4537-ad68-c75faa53f0da.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 787, tv_nsec: 243336149 } }) unit = producer-server
4582026-04-07T18:43:31.341ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4592026-04-07T18:43:31.373ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4602026-04-07T18:43:31.799ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4612026-04-07T18:43:31.804ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4622026-04-07T18:43:31.806ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4632026-04-07T18:43:31.964ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
4642026-04-07T18:43:32.424ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-04-07T18:43:32.429ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4662026-04-07T18:43:32.431ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672026-04-07T18:43:33.171ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
4682026-04-07T18:43:33.756ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4692026-04-07T18:43:33.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4702026-04-07T18:43:33.763ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4712026-04-07T18:43:34.404ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722026-04-07T18:43:34.408ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4732026-04-07T18:43:34.410ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4742026-04-07T18:43:35.761ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4752026-04-07T18:43:35.766ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4762026-04-07T18:43:35.769ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4772026-04-07T18:43:36.797ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4782026-04-07T18:43:36.802ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4792026-04-07T18:43:36.805ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4802026-04-07T18:43:37.648ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812026-04-07T18:43:37.652ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4822026-04-07T18:43:37.655ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4832026-04-07T18:43:38.687ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-04-07T18:43:38.691ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4852026-04-07T18:43:38.694ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4862026-04-07T18:43:39.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-04-07T18:43:39.614ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4882026-04-07T18:43:39.617ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4892026-04-07T18:43:40.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-04-07T18:43:40.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4912026-04-07T18:43:40.399ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4922026-04-07T18:43:41.836ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-04-07T18:43:41.840ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4942026-04-07T18:43:41.843ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4952026-04-07T18:43:41.939ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
4962026-04-07T18:43:43.137ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972026-04-07T18:43:43.142ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
4982026-04-07T18:43:43.145ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
4992026-04-07T18:43:43.145ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5002026-04-07T18:43:44.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5012026-04-07T18:43:44.222ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5022026-04-07T18:43:44.225ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5032026-04-07T18:43:45.532ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5042026-04-07T18:43:45.546ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5052026-04-07T18:43:45.551ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5062026-04-07T18:43:46.334ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
5072026-04-07T18:43:46.335ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 134.439250163s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
5082026-04-07T18:43:46.676ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5092026-04-07T18:43:46.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5102026-04-07T18:43:46.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5112026-04-07T18:43:47.544ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5122026-04-07T18:43:47.672ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5132026-04-07T18:43:47.690ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5142026-04-07T18:43:48.739ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5152026-04-07T18:43:48.746ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5162026-04-07T18:43:48.750ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5172026-04-07T18:43:49.783ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5182026-04-07T18:43:49.788ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5192026-04-07T18:43:49.791ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5202026-04-07T18:43:50.473ZINFOtfportd: removed stale NDP entry :fe80::ce:83ff:fe3e:ffd0->02:ce:83:3e:ff:d0
5212026-04-07T18:43:50.945ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-04-07T18:43:50.952ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5232026-04-07T18:43:50.956ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242026-04-07T18:43:51.915ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
5252026-04-07T18:43:52.032ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5262026-04-07T18:43:52.039ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5272026-04-07T18:43:52.042ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5282026-04-07T18:43:52.381ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ce:83ff:fe3e:ffd0->02:ce:83:3e:ff:d0 interface = tfportrear0_0
5292026-04-07T18:43:52.783ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5302026-04-07T18:43:52.791ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5312026-04-07T18:43:52.796ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5322026-04-07T18:43:53.120ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
5332026-04-07T18:43:53.519ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342026-04-07T18:43:53.525ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5352026-04-07T18:43:53.527ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5362026-04-07T18:43:54.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5372026-04-07T18:43:54.395ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5382026-04-07T18:43:54.398ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5392026-04-07T18:43:55.026ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5402026-04-07T18:43:55.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5412026-04-07T18:43:55.038ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5422026-04-07T18:43:56.529ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5432026-04-07T18:43:56.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5442026-04-07T18:43:56.537ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5452026-04-07T18:43:57.888ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5462026-04-07T18:43:57.895ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5472026-04-07T18:43:57.899ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5482026-04-07T18:43:59.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5492026-04-07T18:43:59.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5502026-04-07T18:43:59.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5512026-04-07T18:44:00.532ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5522026-04-07T18:44:00.538ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5532026-04-07T18:44:00.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5542026-04-07T18:44:00.827ZINFOtfportd: removed stale NDP entry :fe80::ce:83ff:fe3e:ffd0->02:ce:83:3e:ff:d0
5552026-04-07T18:44:01.804ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5562026-04-07T18:44:01.812ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5572026-04-07T18:44:01.817ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5582026-04-07T18:44:01.866ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ce:83ff:fe3e:ffd0->02:ce:83:3e:ff:d0 interface = tfportrear0_0
5592026-04-07T18:44:01.913ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
5602026-04-07T18:44:03.120ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
5612026-04-07T18:44:03.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5622026-04-07T18:44:03.304ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5632026-04-07T18:44:03.307ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5642026-04-07T18:44:03.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5652026-04-07T18:44:03.896ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5662026-04-07T18:44:03.899ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5672026-04-07T18:44:04.798ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5682026-04-07T18:44:04.803ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5692026-04-07T18:44:04.806ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5702026-04-07T18:44:06.018ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5712026-04-07T18:44:06.025ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5722026-04-07T18:44:06.029ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5732026-04-07T18:44:07.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5742026-04-07T18:44:07.163ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5752026-04-07T18:44:07.167ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5762026-04-07T18:44:08.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5772026-04-07T18:44:08.467ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5782026-04-07T18:44:08.469ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5792026-04-07T18:44:09.916ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5802026-04-07T18:44:09.921ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5812026-04-07T18:44:09.924ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5822026-04-07T18:44:11.343ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5832026-04-07T18:44:11.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5842026-04-07T18:44:11.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5852026-04-07T18:44:11.915ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
5862026-04-07T18:44:12.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5872026-04-07T18:44:12.154ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5882026-04-07T18:44:12.157ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5892026-04-07T18:44:13.121ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
5902026-04-07T18:44:13.511ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5912026-04-07T18:44:13.515ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5922026-04-07T18:44:13.518ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5932026-04-07T18:44:14.319ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5942026-04-07T18:44:14.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5952026-04-07T18:44:14.328ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5962026-04-07T18:44:15.265ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5972026-04-07T18:44:15.269ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
5982026-04-07T18:44:15.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5992026-04-07T18:44:15.881ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("189420b8-8e87-4144-950f-5019d1146431.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9654aa96-0cfa-4537-ad68-c75faa53f0da.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bc51defb-f635-4b22-bce5-7bb30851da57.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 831, tv_nsec: 846427949 } }) unit = producer-server
6002026-04-07T18:44:15.882ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
6012026-04-07T18:44:15.922ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
6022026-04-07T18:44:16.381ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6032026-04-07T18:44:16.385ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6042026-04-07T18:44:16.388ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6052026-04-07T18:44:16.900ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6062026-04-07T18:44:16.904ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6072026-04-07T18:44:16.907ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6082026-04-07T18:44:17.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6092026-04-07T18:44:17.510ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6102026-04-07T18:44:17.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6112026-04-07T18:44:18.667ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6122026-04-07T18:44:18.672ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6132026-04-07T18:44:18.675ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6142026-04-07T18:44:19.522ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6152026-04-07T18:44:19.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6162026-04-07T18:44:19.531ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6172026-04-07T18:44:20.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6182026-04-07T18:44:20.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6192026-04-07T18:44:20.195ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6202026-04-07T18:44:21.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6212026-04-07T18:44:21.413ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6222026-04-07T18:44:21.417ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6232026-04-07T18:44:21.917ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
6242026-04-07T18:44:22.794ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6252026-04-07T18:44:22.798ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6262026-04-07T18:44:22.801ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6272026-04-07T18:44:23.123ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
6282026-04-07T18:44:23.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6292026-04-07T18:44:23.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6302026-04-07T18:44:23.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6312026-04-07T18:44:24.871ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6322026-04-07T18:44:24.877ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6332026-04-07T18:44:24.880ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6342026-04-07T18:44:25.756ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6352026-04-07T18:44:25.761ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6362026-04-07T18:44:25.764ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6372026-04-07T18:44:26.848ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6382026-04-07T18:44:26.854ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6392026-04-07T18:44:26.857ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6402026-04-07T18:44:28.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6412026-04-07T18:44:28.005ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6422026-04-07T18:44:28.008ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6432026-04-07T18:44:29.386ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6442026-04-07T18:44:29.391ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6452026-04-07T18:44:29.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6462026-04-07T18:44:30.056ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6472026-04-07T18:44:30.062ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6482026-04-07T18:44:30.066ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6492026-04-07T18:44:30.923ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
6502026-04-07T18:44:30.925ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 8 delay = 179.050386288s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
6512026-04-07T18:44:30.936ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6522026-04-07T18:44:30.941ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6532026-04-07T18:44:30.944ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6542026-04-07T18:44:31.656ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6552026-04-07T18:44:31.661ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6562026-04-07T18:44:31.664ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6572026-04-07T18:44:31.919ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
6582026-04-07T18:44:33.055ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6592026-04-07T18:44:33.060ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6602026-04-07T18:44:33.063ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6612026-04-07T18:44:33.125ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
6622026-04-07T18:44:34.165ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6632026-04-07T18:44:34.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6642026-04-07T18:44:34.173ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6652026-04-07T18:44:35.525ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6662026-04-07T18:44:35.531ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6672026-04-07T18:44:35.534ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6682026-04-07T18:44:36.710ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6692026-04-07T18:44:36.715ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6702026-04-07T18:44:36.718ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6712026-04-07T18:44:37.757ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6722026-04-07T18:44:37.762ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6732026-04-07T18:44:37.766ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6742026-04-07T18:44:38.405ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6752026-04-07T18:44:38.415ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6762026-04-07T18:44:38.419ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6772026-04-07T18:44:39.296ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6782026-04-07T18:44:39.301ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6792026-04-07T18:44:39.305ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6802026-04-07T18:44:40.645ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6812026-04-07T18:44:40.650ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6822026-04-07T18:44:40.653ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6832026-04-07T18:44:41.921ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
6842026-04-07T18:44:42.135ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6852026-04-07T18:44:42.140ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6862026-04-07T18:44:42.143ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6872026-04-07T18:44:43.131ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
6882026-04-07T18:44:43.161ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6892026-04-07T18:44:43.166ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6902026-04-07T18:44:43.169ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6912026-04-07T18:44:44.266ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6922026-04-07T18:44:44.270ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6932026-04-07T18:44:44.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6942026-04-07T18:44:45.776ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6952026-04-07T18:44:45.781ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6962026-04-07T18:44:45.783ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6972026-04-07T18:44:47.092ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6982026-04-07T18:44:47.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
6992026-04-07T18:44:47.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7002026-04-07T18:44:48.529ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7012026-04-07T18:44:48.534ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7022026-04-07T18:44:48.537ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7032026-04-07T18:44:49.647ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7042026-04-07T18:44:49.652ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7052026-04-07T18:44:49.656ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7062026-04-07T18:44:50.606ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7072026-04-07T18:44:50.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7082026-04-07T18:44:50.614ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7092026-04-07T18:44:51.687ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7102026-04-07T18:44:51.695ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7112026-04-07T18:44:51.701ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7122026-04-07T18:44:51.925ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter
7132026-04-07T18:44:56.492ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12882058990794922576 n_samples = 6 unit = oximeter
7142026-04-07T18:44:56.544ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7152026-04-07T18:44:57.109ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7162026-04-07T18:44:57.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7172026-04-07T18:44:58.118ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7182026-04-07T18:44:58.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7192026-04-07T18:44:58.133ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7202026-04-07T18:44:59.506ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7212026-04-07T18:44:59.515ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7222026-04-07T18:44:59.531ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7232026-04-07T18:45:00.375ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7242026-04-07T18:45:00.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7252026-04-07T18:45:00.403ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7262026-04-07T18:45:01.657ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7272026-04-07T18:45:01.665ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cc27:89ff:fe40:bc36]
7282026-04-07T18:45:01.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7292026-04-07T18:45:01.961ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9659655969040896701 n_samples = 6 unit = oximeter