Max level shown:
1 [ Mar 24 18:27:09 Enabled. ]
2 [ Mar 24 18:27:09 Rereading configuration. ]
3 [ Mar 24 18:27:10 Rereading configuration. ]
4 [ Mar 24 18:27:31 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Mar 24 18:27:31 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-03-24T18:27:31.575ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-03-24T18:27:31.578ZINFOtfportd: connected to dpd running softnpu-b31ba90d
92026-03-24T18:27:31.578ZINFOtfportd: running in sync-only mode
102026-03-24T18:27:31.579ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-03-24T18:27:31.580ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-03-24T18:27:31.582ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 386a345e-f45a-414e-a736-ceb668826f36, ), sled_id: Some( 32482131-2003-4c82-8bdf-7b718f891115, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-03-24T18:27:31.582ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-03-24T18:27:31.586ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::78d6:7cff:feba:a5c8->7a:d6:7c:ba:a5:c8 interface = tfportrear0_0
162026-03-24T18:27:31.588ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-03-24T18:27:31.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
182026-03-24T18:27:31.598ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Mar 24 18:27:32 Rereading configuration. ]
20 [ Mar 24 18:27:32 Executing refresh method (:kill). ]
21 [ Mar 24 18:27:32 Stopping because all processes in service exited. ]
22 [ Mar 24 18:27:32 Executing stop method (:kill). ]
23 [ Mar 24 18:27:32 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Mar 24 18:27:32 Method "start" exited with status 0. ]
252026-03-24T18:27:32.134ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-03-24T18:27:32.135ZINFOtfportd: connected to dpd running softnpu-b31ba90d
272026-03-24T18:27:32.135ZINFOtfportd: running in sync-only mode
282026-03-24T18:27:32.135ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-03-24T18:27:32.137ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-03-24T18:27:32.137ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 386a345e-f45a-414e-a736-ceb668826f36, sled_id: 32482131-2003-4c82-8bdf-7b718f891115, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: d0b8fbd1-c779-47f3-9fb8-dd9ada2708c9, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-03-24T18:27:32.137ZDEBGtfportd: created producer ID producer_id = da9aeebe-1320-4a3f-b351-685d3d2c76ea unit = oximeter
322026-03-24T18:27:32.138ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 386a345e-f45a-414e-a736-ceb668826f36, ), sled_id: Some( 32482131-2003-4c82-8bdf-7b718f891115, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-03-24T18:27:32.144ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-03-24T18:27:32.146ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::705c:acff:fe22:5c1d->72:5c:ac:22:5c:1d interface = tfportrear0_0
352026-03-24T18:27:32.147ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::78d6:7cff:feba:a5c8->7a:d6:7c:ba:a5:c8 interface = tfportrear0_0
362026-03-24T18:27:32.148ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-03-24T18:27:32.149ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:61860 method = GET path = /{producer_id} unit = producer-server versions = all
382026-03-24T18:27:32.149ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:61860 unit = producer-server
392026-03-24T18:27:32.149ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:61860 unit = producer-server
402026-03-24T18:27:32.149ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:61860 unit = producer-server
412026-03-24T18:27:32.149ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-03-24T18:27:32.149ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-03-24T18:27:32.150ZDEBGtfportd: starting producer registration task unit = producer-server
442026-03-24T18:27:32.150ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:61860 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = da9aeebe-1320-4a3f-b351-685d3d2c76ea unit = producer-server
452026-03-24T18:27:32.150ZINFOtfportd: created oximeter producer server unit = oximeter
462026-03-24T18:27:32.150ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-03-24T18:27:32.151ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
482026-03-24T18:27:32.151ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-03-24T18:27:32.151ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 1.244417ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
502026-03-24T18:27:32.152ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-03-24T18:27:05.652954196Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512026-03-24T18:27:32.152ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 10076660720119290418 unit = oximeter
522026-03-24T18:27:32.152ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532026-03-24T18:27:32.154ZWARNtfportd: tfportqsfp0_0 has no addrs
542026-03-24T18:27:32.394ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 244.376603ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
552026-03-24T18:27:32.921ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8b83c400-e1c0-469e-85c8-5bb331c1da4a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c905ef06-5a5e-4a11-80e9-a5a040e18016.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 662, tv_nsec: 277330575 } }) unit = producer-server
562026-03-24T18:27:32.921ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
572026-03-24T18:27:32.963ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
582026-03-24T18:27:33.120ZINFOtfportd: added new ARP entry entry = 10.151.1.174->3a:f7:8a:08:47:d5 interface = tfportqsfp0_0
592026-03-24T18:27:33.606ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
602026-03-24T18:27:33.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
612026-03-24T18:27:33.616ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
622026-03-24T18:27:33.616ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
632026-03-24T18:27:33.618ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-03-24T18:27:05.652824014Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
642026-03-24T18:27:33.618ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 16277160016119814522 unit = oximeter
652026-03-24T18:27:33.618ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
662026-03-24T18:27:34.682ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
672026-03-24T18:27:34.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
682026-03-24T18:27:34.690ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
692026-03-24T18:27:35.496ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
702026-03-24T18:27:35.500ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
712026-03-24T18:27:35.503ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
722026-03-24T18:27:36.915ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
732026-03-24T18:27:36.921ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
742026-03-24T18:27:36.923ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
752026-03-24T18:27:38.416ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
762026-03-24T18:27:38.421ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
772026-03-24T18:27:38.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
782026-03-24T18:27:39.243ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
792026-03-24T18:27:39.247ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
802026-03-24T18:27:39.250ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
812026-03-24T18:27:40.432ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
822026-03-24T18:27:40.437ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
832026-03-24T18:27:40.440ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
842026-03-24T18:27:41.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
852026-03-24T18:27:41.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
862026-03-24T18:27:41.022ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
872026-03-24T18:27:41.702ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-03-24T18:27:41.707ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
892026-03-24T18:27:41.709ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
902026-03-24T18:27:42.158ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
912026-03-24T18:27:43.023ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
922026-03-24T18:27:43.028ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
932026-03-24T18:27:43.030ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
942026-03-24T18:27:43.621ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
952026-03-24T18:27:44.192ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
962026-03-24T18:27:44.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
972026-03-24T18:27:44.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
982026-03-24T18:27:45.034ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
992026-03-24T18:27:45.038ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1002026-03-24T18:27:45.041ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1012026-03-24T18:27:45.904ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1022026-03-24T18:27:45.910ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1032026-03-24T18:27:45.914ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1042026-03-24T18:27:46.535ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1052026-03-24T18:27:46.540ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1062026-03-24T18:27:46.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1072026-03-24T18:27:47.669ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1082026-03-24T18:27:47.677ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1092026-03-24T18:27:47.681ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1102026-03-24T18:27:47.774ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1112026-03-24T18:27:47.775ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 15.816034695s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1122026-03-24T18:27:48.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132026-03-24T18:27:48.352ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1142026-03-24T18:27:48.363ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1152026-03-24T18:27:48.842ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8b83c400-e1c0-469e-85c8-5bb331c1da4a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c905ef06-5a5e-4a11-80e9-a5a040e18016.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 678, tv_nsec: 391606598 } }) unit = producer-server
1162026-03-24T18:27:48.876ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1172026-03-24T18:27:48.957ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1182026-03-24T18:27:49.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192026-03-24T18:27:49.351ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1202026-03-24T18:27:49.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1212026-03-24T18:27:50.380ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1222026-03-24T18:27:50.387ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1232026-03-24T18:27:50.393ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1242026-03-24T18:27:51.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-03-24T18:27:51.160ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1262026-03-24T18:27:51.164ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272026-03-24T18:27:51.842ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-03-24T18:27:51.846ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1292026-03-24T18:27:51.850ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-03-24T18:27:51.959ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
1312026-03-24T18:27:52.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1322026-03-24T18:27:52.457ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1332026-03-24T18:27:52.461ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1342026-03-24T18:27:53.227ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-03-24T18:27:53.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1362026-03-24T18:27:53.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372026-03-24T18:27:53.417ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
1382026-03-24T18:27:54.263ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1392026-03-24T18:27:54.267ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1402026-03-24T18:27:54.270ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1412026-03-24T18:27:55.594ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1422026-03-24T18:27:55.599ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1432026-03-24T18:27:55.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1442026-03-24T18:27:56.946ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1452026-03-24T18:27:56.951ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1462026-03-24T18:27:56.954ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1472026-03-24T18:27:58.138ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1482026-03-24T18:27:58.144ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1492026-03-24T18:27:58.148ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1502026-03-24T18:27:59.698ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1512026-03-24T18:27:59.702ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1522026-03-24T18:27:59.705ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1532026-03-24T18:28:01.163ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1542026-03-24T18:28:01.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1552026-03-24T18:28:01.174ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1562026-03-24T18:28:01.943ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
1572026-03-24T18:28:02.597ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1582026-03-24T18:28:02.603ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1592026-03-24T18:28:02.606ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1602026-03-24T18:28:03.391ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
1612026-03-24T18:28:03.920ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1622026-03-24T18:28:03.922ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 32.006385697s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1632026-03-24T18:28:03.965ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-03-24T18:28:03.969ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1652026-03-24T18:28:03.972ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1662026-03-24T18:28:05.038ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672026-03-24T18:28:05.043ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1682026-03-24T18:28:05.046ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1692026-03-24T18:28:05.412ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8b83c400-e1c0-469e-85c8-5bb331c1da4a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c905ef06-5a5e-4a11-80e9-a5a040e18016.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 695, tv_nsec: 6592974 } }) unit = producer-server
1702026-03-24T18:28:05.412ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1712026-03-24T18:28:05.447ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1722026-03-24T18:28:05.934ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1732026-03-24T18:28:05.938ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1742026-03-24T18:28:05.941ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1752026-03-24T18:28:07.041ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1762026-03-24T18:28:07.046ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1772026-03-24T18:28:07.050ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1782026-03-24T18:28:08.364ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1792026-03-24T18:28:08.368ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1802026-03-24T18:28:08.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1812026-03-24T18:28:09.120ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1822026-03-24T18:28:09.125ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1832026-03-24T18:28:09.128ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1842026-03-24T18:28:09.700ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1852026-03-24T18:28:09.705ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1862026-03-24T18:28:09.708ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1872026-03-24T18:28:10.269ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882026-03-24T18:28:10.274ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1892026-03-24T18:28:10.277ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1902026-03-24T18:28:11.169ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-03-24T18:28:11.173ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1922026-03-24T18:28:11.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932026-03-24T18:28:11.918ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
1942026-03-24T18:28:12.515ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952026-03-24T18:28:12.520ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
1962026-03-24T18:28:12.523ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1972026-03-24T18:28:13.366ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
1982026-03-24T18:28:13.548ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1992026-03-24T18:28:13.553ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2002026-03-24T18:28:13.555ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2012026-03-24T18:28:14.087ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2022026-03-24T18:28:14.093ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2032026-03-24T18:28:14.097ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2042026-03-24T18:28:14.637ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2052026-03-24T18:28:14.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2062026-03-24T18:28:14.645ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2072026-03-24T18:28:15.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2082026-03-24T18:28:15.725ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2092026-03-24T18:28:15.728ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2102026-03-24T18:28:17.197ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2112026-03-24T18:28:17.203ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2122026-03-24T18:28:17.206ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2132026-03-24T18:28:18.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2142026-03-24T18:28:18.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2152026-03-24T18:28:18.396ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2162026-03-24T18:28:19.760ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172026-03-24T18:28:19.765ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2182026-03-24T18:28:19.768ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2192026-03-24T18:28:20.408ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2202026-03-24T18:28:20.409ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 48.53880067s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2212026-03-24T18:28:20.949ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222026-03-24T18:28:20.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2232026-03-24T18:28:20.958ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2242026-03-24T18:28:21.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252026-03-24T18:28:21.863ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2262026-03-24T18:28:21.865ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272026-03-24T18:28:21.892ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
2282026-03-24T18:28:22.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292026-03-24T18:28:22.663ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2302026-03-24T18:28:22.666ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2312026-03-24T18:28:23.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322026-03-24T18:28:23.229ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2332026-03-24T18:28:23.232ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2342026-03-24T18:28:23.340ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8b83c400-e1c0-469e-85c8-5bb331c1da4a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c905ef06-5a5e-4a11-80e9-a5a040e18016.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 712, tv_nsec: 983184603 } }) unit = producer-server
2352026-03-24T18:28:23.340ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2362026-03-24T18:28:23.341ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
2372026-03-24T18:28:23.373ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2382026-03-24T18:28:24.728ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392026-03-24T18:28:24.734ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2402026-03-24T18:28:24.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2412026-03-24T18:28:26.061ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2422026-03-24T18:28:26.066ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2432026-03-24T18:28:26.069ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2442026-03-24T18:28:26.717ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2452026-03-24T18:28:26.722ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2462026-03-24T18:28:26.725ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2472026-03-24T18:28:27.316ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2482026-03-24T18:28:27.321ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2492026-03-24T18:28:27.324ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2502026-03-24T18:28:28.178ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2512026-03-24T18:28:28.183ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2522026-03-24T18:28:28.186ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2532026-03-24T18:28:29.688ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2542026-03-24T18:28:29.694ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2552026-03-24T18:28:29.697ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2562026-03-24T18:28:30.665ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2572026-03-24T18:28:30.670ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2582026-03-24T18:28:30.673ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2592026-03-24T18:28:31.308ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602026-03-24T18:28:31.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2612026-03-24T18:28:31.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622026-03-24T18:28:31.867ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
2632026-03-24T18:28:32.324ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642026-03-24T18:28:32.329ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2652026-03-24T18:28:32.332ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2662026-03-24T18:28:33.026ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672026-03-24T18:28:33.031ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2682026-03-24T18:28:33.061ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2692026-03-24T18:28:33.315ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
2702026-03-24T18:28:34.125ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712026-03-24T18:28:34.130ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2722026-03-24T18:28:34.133ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2732026-03-24T18:28:34.810ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-03-24T18:28:34.815ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2752026-03-24T18:28:34.818ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762026-03-24T18:28:35.396ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-03-24T18:28:35.401ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2782026-03-24T18:28:35.405ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792026-03-24T18:28:36.363ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-03-24T18:28:36.369ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2812026-03-24T18:28:36.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-03-24T18:28:37.161ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-03-24T18:28:37.167ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2842026-03-24T18:28:37.170ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2852026-03-24T18:28:38.276ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-03-24T18:28:38.282ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2872026-03-24T18:28:38.285ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882026-03-24T18:28:38.335ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2892026-03-24T18:28:38.336ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 66.513399694s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2902026-03-24T18:28:39.586ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912026-03-24T18:28:39.592ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2922026-03-24T18:28:39.595ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2932026-03-24T18:28:40.679ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-03-24T18:28:40.685ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2952026-03-24T18:28:40.689ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-03-24T18:28:41.841ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
2972026-03-24T18:28:42.057ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-03-24T18:28:42.061ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
2992026-03-24T18:28:42.064ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3002026-03-24T18:28:43.161ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-03-24T18:28:43.166ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3022026-03-24T18:28:43.169ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3032026-03-24T18:28:43.291ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
3042026-03-24T18:28:43.417ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8b83c400-e1c0-469e-85c8-5bb331c1da4a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c905ef06-5a5e-4a11-80e9-a5a040e18016.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 733, tv_nsec: 114630742 } }) unit = producer-server
3052026-03-24T18:28:43.417ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3062026-03-24T18:28:43.449ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3072026-03-24T18:28:44.201ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3082026-03-24T18:28:44.206ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3092026-03-24T18:28:44.209ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3102026-03-24T18:28:45.277ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-03-24T18:28:45.282ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3122026-03-24T18:28:45.285ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132026-03-24T18:28:46.643ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3142026-03-24T18:28:46.649ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3152026-03-24T18:28:46.652ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3162026-03-24T18:28:47.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3172026-03-24T18:28:47.314ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3182026-03-24T18:28:47.317ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3192026-03-24T18:28:48.087ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3202026-03-24T18:28:48.093ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3212026-03-24T18:28:48.096ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3222026-03-24T18:28:48.951ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3232026-03-24T18:28:48.957ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3242026-03-24T18:28:48.960ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3252026-03-24T18:28:50.424ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262026-03-24T18:28:50.429ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3272026-03-24T18:28:50.432ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3282026-03-24T18:28:51.815ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
3292026-03-24T18:28:51.826ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3302026-03-24T18:28:51.830ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3312026-03-24T18:28:51.833ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3322026-03-24T18:28:52.770ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3332026-03-24T18:28:52.776ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3342026-03-24T18:28:52.779ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3352026-03-24T18:28:53.266ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
3362026-03-24T18:28:53.589ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-03-24T18:28:53.594ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3382026-03-24T18:28:53.597ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392026-03-24T18:28:54.740ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-03-24T18:28:54.745ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3412026-03-24T18:28:54.748ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-03-24T18:28:56.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-03-24T18:28:56.044ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3442026-03-24T18:28:56.047ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3452026-03-24T18:28:57.098ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-03-24T18:28:57.103ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3472026-03-24T18:28:57.106ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3482026-03-24T18:28:58.410ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3492026-03-24T18:28:58.412ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 86.643798217s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3502026-03-24T18:28:58.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512026-03-24T18:28:58.556ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3522026-03-24T18:28:58.559ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532026-03-24T18:28:59.637ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542026-03-24T18:28:59.643ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3552026-03-24T18:28:59.645ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3562026-03-24T18:29:00.510ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-03-24T18:29:00.514ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3582026-03-24T18:29:00.518ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3592026-03-24T18:29:01.238ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-03-24T18:29:01.244ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3612026-03-24T18:29:01.247ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622026-03-24T18:29:01.789ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
3632026-03-24T18:29:02.617ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-03-24T18:29:02.623ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3652026-03-24T18:29:02.626ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3662026-03-24T18:29:03.241ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
3672026-03-24T18:29:04.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3682026-03-24T18:29:04.021ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3692026-03-24T18:29:04.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3702026-03-24T18:29:05.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712026-03-24T18:29:05.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3722026-03-24T18:29:05.400ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3732026-03-24T18:29:06.681ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8b83c400-e1c0-469e-85c8-5bb331c1da4a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c905ef06-5a5e-4a11-80e9-a5a040e18016.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 756, tv_nsec: 441628326 } }) unit = producer-server
3742026-03-24T18:29:06.682ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3752026-03-24T18:29:06.713ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3762026-03-24T18:29:06.786ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3772026-03-24T18:29:06.791ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3782026-03-24T18:29:06.794ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3792026-03-24T18:29:08.124ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802026-03-24T18:29:08.129ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3812026-03-24T18:29:08.133ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822026-03-24T18:29:09.012ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832026-03-24T18:29:09.017ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3842026-03-24T18:29:09.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3852026-03-24T18:29:09.727ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862026-03-24T18:29:09.737ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3872026-03-24T18:29:09.741ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3882026-03-24T18:29:10.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3892026-03-24T18:29:10.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3902026-03-24T18:29:10.318ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3912026-03-24T18:29:17.411ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
3922026-03-24T18:29:17.413ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
3932026-03-24T18:29:17.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3942026-03-24T18:29:17.558ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3952026-03-24T18:29:17.582ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3962026-03-24T18:29:18.407ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3972026-03-24T18:29:18.415ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
3982026-03-24T18:29:18.426ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3992026-03-24T18:29:19.236ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4002026-03-24T18:29:19.243ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4012026-03-24T18:29:19.251ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4022026-03-24T18:29:20.575ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4032026-03-24T18:29:20.590ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4042026-03-24T18:29:20.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4052026-03-24T18:29:21.684ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4062026-03-24T18:29:21.738ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 110.032632912s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4072026-03-24T18:29:21.754ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082026-03-24T18:29:21.763ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4092026-03-24T18:29:21.768ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102026-03-24T18:29:23.084ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112026-03-24T18:29:23.093ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4122026-03-24T18:29:23.103ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4132026-03-24T18:29:23.627ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142026-03-24T18:29:23.635ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4152026-03-24T18:29:23.640ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162026-03-24T18:29:24.626ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172026-03-24T18:29:24.632ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4182026-03-24T18:29:24.636ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4192026-03-24T18:29:26.074ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202026-03-24T18:29:26.080ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4212026-03-24T18:29:26.085ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4222026-03-24T18:29:27.308ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4232026-03-24T18:29:27.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4242026-03-24T18:29:27.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4252026-03-24T18:29:27.395ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
4262026-03-24T18:29:27.396ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
4272026-03-24T18:29:28.821ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4282026-03-24T18:29:28.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4292026-03-24T18:29:28.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4302026-03-24T18:29:29.600ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4312026-03-24T18:29:29.607ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4322026-03-24T18:29:29.611ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4332026-03-24T18:29:30.359ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4342026-03-24T18:29:30.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4352026-03-24T18:29:30.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4362026-03-24T18:29:31.321ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372026-03-24T18:29:31.326ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4382026-03-24T18:29:31.329ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4392026-03-24T18:29:32.676ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-03-24T18:29:32.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4412026-03-24T18:29:32.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4422026-03-24T18:29:33.452ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4432026-03-24T18:29:33.457ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4442026-03-24T18:29:33.460ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4452026-03-24T18:29:34.713ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462026-03-24T18:29:34.718ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4472026-03-24T18:29:34.721ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4482026-03-24T18:29:35.854ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4492026-03-24T18:29:35.859ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4502026-03-24T18:29:35.863ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4512026-03-24T18:29:37.159ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4522026-03-24T18:29:37.164ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4532026-03-24T18:29:37.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4542026-03-24T18:29:37.399ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
4552026-03-24T18:29:37.399ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
4562026-03-24T18:29:38.148ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572026-03-24T18:29:38.155ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4582026-03-24T18:29:38.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4592026-03-24T18:29:39.435ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602026-03-24T18:29:39.440ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4612026-03-24T18:29:39.444ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4622026-03-24T18:29:40.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4632026-03-24T18:29:40.664ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4642026-03-24T18:29:40.674ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4652026-03-24T18:29:41.585ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4662026-03-24T18:29:41.603ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4672026-03-24T18:29:41.607ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4682026-03-24T18:29:41.608ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8b83c400-e1c0-469e-85c8-5bb331c1da4a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c905ef06-5a5e-4a11-80e9-a5a040e18016.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d91310-63a5-44de-9b67-4f45f38bc5dd.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 791, tv_nsec: 412875433 } }) unit = producer-server
4692026-03-24T18:29:41.609ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4702026-03-24T18:29:41.679ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4712026-03-24T18:29:42.722ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722026-03-24T18:29:42.730ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4732026-03-24T18:29:42.736ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4742026-03-24T18:29:43.714ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4752026-03-24T18:29:43.722ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4762026-03-24T18:29:43.725ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4772026-03-24T18:29:44.957ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4782026-03-24T18:29:44.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4792026-03-24T18:29:44.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4802026-03-24T18:29:45.527ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812026-03-24T18:29:45.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4822026-03-24T18:29:45.536ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4832026-03-24T18:29:46.696ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-03-24T18:29:46.701ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4852026-03-24T18:29:46.704ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4862026-03-24T18:29:47.402ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
4872026-03-24T18:29:47.402ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
4882026-03-24T18:29:48.102ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4892026-03-24T18:29:48.109ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4902026-03-24T18:29:48.112ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4912026-03-24T18:29:49.595ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
4922026-03-24T18:29:49.597ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 8 delay = 137.898557726s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4932026-03-24T18:29:49.620ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942026-03-24T18:29:49.626ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4952026-03-24T18:29:49.629ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4962026-03-24T18:29:50.998ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972026-03-24T18:29:51.004ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
4982026-03-24T18:29:51.008ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4992026-03-24T18:29:52.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002026-03-24T18:29:52.171ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5012026-03-24T18:29:52.174ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5022026-03-24T18:29:53.368ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5032026-03-24T18:29:53.378ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5042026-03-24T18:29:53.381ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5052026-03-24T18:29:54.360ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062026-03-24T18:29:54.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5072026-03-24T18:29:54.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5082026-03-24T18:29:55.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5092026-03-24T18:29:55.098ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5102026-03-24T18:29:55.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5112026-03-24T18:29:55.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5122026-03-24T18:29:55.900ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5132026-03-24T18:29:55.904ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5142026-03-24T18:29:56.496ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5152026-03-24T18:29:56.502ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5162026-03-24T18:29:56.506ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5172026-03-24T18:29:57.336ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5182026-03-24T18:29:57.342ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5192026-03-24T18:29:57.345ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5202026-03-24T18:29:57.406ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10076660720119290418 n_samples = 6 unit = oximeter
5212026-03-24T18:29:57.406ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16277160016119814522 n_samples = 6 unit = oximeter
5222026-03-24T18:29:58.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5232026-03-24T18:29:58.160ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5242026-03-24T18:29:58.164ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5252026-03-24T18:29:59.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5262026-03-24T18:29:59.588ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5272026-03-24T18:29:59.591ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5282026-03-24T18:30:00.141ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5292026-03-24T18:30:00.149ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5302026-03-24T18:30:00.155ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5312026-03-24T18:30:01.120ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5322026-03-24T18:30:01.130ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::78d6:7cff:feba:a5c8]
5332026-03-24T18:30:01.134ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]