Max level shown:
1 [ Nov 3 05:57:12 Enabled. ]
2 [ Nov 3 05:57:12 Rereading configuration. ]
3 [ Nov 3 05:57:13 Rereading configuration. ]
4 [ Nov 3 05:57:24 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Nov 3 05:57:24 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-11-03T05:57:24.774ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-11-03T05:57:24.776ZINFOtfportd: connected to dpd running softnpu-a133c73e
92026-11-03T05:57:24.776ZINFOtfportd: running in sync-only mode
102026-11-03T05:57:24.776ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-11-03T05:57:24.777ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-11-03T05:57:24.778ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( f48391eb-d9fb-4496-b275-f2cff05ebd9b, ), sled_id: Some( 4a65f178-543f-4d30-9b11-7d920d0ae7b9, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-11-03T05:57:24.778ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-11-03T05:57:24.784ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::5493:3fff:fe3c:5aba->56:93:3f:3c:5a:ba interface = tfportrear0_0
162026-11-03T05:57:24.784ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-11-03T05:57:24.788ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
182026-11-03T05:57:24.793ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Nov 3 05:57:25 Rereading configuration. ]
20 [ Nov 3 05:57:25 Executing refresh method (:kill). ]
21 [ Nov 3 05:57:25 Stopping because all processes in service exited. ]
22 [ Nov 3 05:57:25 Executing stop method (:kill). ]
23 [ Nov 3 05:57:25 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Nov 3 05:57:25 Method "start" exited with status 0. ]
252026-11-03T05:57:25.406ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-11-03T05:57:25.407ZINFOtfportd: connected to dpd running softnpu-a133c73e
272026-11-03T05:57:25.407ZINFOtfportd: running in sync-only mode
282026-11-03T05:57:25.407ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-11-03T05:57:25.407ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-11-03T05:57:25.408ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: f48391eb-d9fb-4496-b275-f2cff05ebd9b, sled_id: 4a65f178-543f-4d30-9b11-7d920d0ae7b9, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: ca4145bf-ef7e-4106-af13-e00884e7104d, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-11-03T05:57:25.408ZDEBGtfportd: created producer ID producer_id = 74a7252c-62ba-48a0-8677-6f5579b34a6e unit = oximeter
322026-11-03T05:57:25.409ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( f48391eb-d9fb-4496-b275-f2cff05ebd9b, ), sled_id: Some( 4a65f178-543f-4d30-9b11-7d920d0ae7b9, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-11-03T05:57:25.417ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::5493:3fff:fe3c:5aba->56:93:3f:3c:5a:ba interface = tfportrear0_0
342026-11-03T05:57:25.417ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352026-11-03T05:57:25.419ZDEBGtfportd: registered DTrace probes unit = producer-server
362026-11-03T05:57:25.420ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:65495 method = GET path = /{producer_id} unit = producer-server versions = all
372026-11-03T05:57:25.420ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:65495 unit = producer-server
382026-11-03T05:57:25.420ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:65495 unit = producer-server
392026-11-03T05:57:25.420ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:65495 unit = producer-server
402026-11-03T05:57:25.420ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
412026-11-03T05:57:25.420ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
422026-11-03T05:57:25.420ZDEBGtfportd: starting producer registration task unit = producer-server
432026-11-03T05:57:25.420ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:65495 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 74a7252c-62ba-48a0-8677-6f5579b34a6e unit = producer-server
442026-11-03T05:57:25.420ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
452026-11-03T05:57:25.420ZINFOtfportd: created oximeter producer server unit = oximeter
462026-11-03T05:57:25.422ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 1.198652ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
472026-11-03T05:57:25.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
482026-11-03T05:57:25.422ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-11-03T05:57:25.424ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-11-03T05:57:08.234179621Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-11-03T05:57:25.424ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 9836045021275666531 unit = oximeter
512026-11-03T05:57:25.424ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-11-03T05:57:25.425ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-11-03T05:57:25.585ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 164.760563ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
542026-11-03T05:57:26.292ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("126e41a8-8978-422f-b2e8-f23d26036d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("237b3f83-0799-4b9f-a7a2-b9db6e826569.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 588, tv_nsec: 239329544 } }) unit = producer-server
552026-11-03T05:57:26.293ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
562026-11-03T05:57:26.309ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
572026-11-03T05:57:26.533ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
582026-11-03T05:57:26.537ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
592026-11-03T05:57:26.539ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
602026-11-03T05:57:26.539ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
612026-11-03T05:57:26.540ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-11-03T05:57:08.234040889Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
622026-11-03T05:57:26.540ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 7285793101736310781 unit = oximeter
632026-11-03T05:57:26.540ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
642026-11-03T05:57:27.105ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::54c3:aff:fe53:f870->56:c3:0a:53:f8:70 interface = tfportrear0_0
652026-11-03T05:57:27.349ZINFOtfportd: added new ARP entry entry = 10.151.1.174->ba:0c:50:cd:fb:ba interface = tfportqsfp0_0
662026-11-03T05:57:27.996ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
672026-11-03T05:57:28.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
682026-11-03T05:57:28.004ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
692026-11-03T05:57:29.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
702026-11-03T05:57:29.018ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
712026-11-03T05:57:29.021ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
722026-11-03T05:57:30.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
732026-11-03T05:57:30.154ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
742026-11-03T05:57:30.157ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
752026-11-03T05:57:31.375ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
762026-11-03T05:57:31.380ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
772026-11-03T05:57:31.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
782026-11-03T05:57:32.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
792026-11-03T05:57:32.392ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
802026-11-03T05:57:32.395ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
812026-11-03T05:57:32.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
822026-11-03T05:57:32.913ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
832026-11-03T05:57:32.916ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
842026-11-03T05:57:33.616ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
852026-11-03T05:57:33.620ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
862026-11-03T05:57:33.623ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
872026-11-03T05:57:34.143ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-11-03T05:57:34.147ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
892026-11-03T05:57:34.150ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
902026-11-03T05:57:34.979ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912026-11-03T05:57:34.983ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
922026-11-03T05:57:34.986ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932026-11-03T05:57:35.427ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
942026-11-03T05:57:35.670ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952026-11-03T05:57:35.675ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
962026-11-03T05:57:35.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
972026-11-03T05:57:36.542ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
982026-11-03T05:57:36.579ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
992026-11-03T05:57:36.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1002026-11-03T05:57:36.586ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1012026-11-03T05:57:37.452ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1022026-11-03T05:57:37.457ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1032026-11-03T05:57:37.459ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1042026-11-03T05:57:38.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1052026-11-03T05:57:38.346ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1062026-11-03T05:57:38.348ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1072026-11-03T05:57:38.998ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1082026-11-03T05:57:39.003ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1092026-11-03T05:57:39.005ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1102026-11-03T05:57:39.532ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1112026-11-03T05:57:39.536ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1122026-11-03T05:57:39.539ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1132026-11-03T05:57:40.246ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1142026-11-03T05:57:40.250ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1152026-11-03T05:57:40.253ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1162026-11-03T05:57:41.376ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1172026-11-03T05:57:41.376ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 15.890832678s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1182026-11-03T05:57:41.934ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192026-11-03T05:57:41.938ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1202026-11-03T05:57:41.941ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1212026-11-03T05:57:42.788ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("126e41a8-8978-422f-b2e8-f23d26036d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("237b3f83-0799-4b9f-a7a2-b9db6e826569.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 604, tv_nsec: 670227835 } }) unit = producer-server
1222026-11-03T05:57:42.788ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1232026-11-03T05:57:42.794ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1242026-11-03T05:57:43.212ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-11-03T05:57:43.217ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1262026-11-03T05:57:43.219ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272026-11-03T05:57:44.119ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-11-03T05:57:44.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1292026-11-03T05:57:44.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-11-03T05:57:45.151ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-11-03T05:57:45.155ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1322026-11-03T05:57:45.158ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-11-03T05:57:45.502ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
1342026-11-03T05:57:46.500ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-11-03T05:57:46.504ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1362026-11-03T05:57:46.507ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372026-11-03T05:57:46.620ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
1382026-11-03T05:57:47.400ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1392026-11-03T05:57:47.405ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1402026-11-03T05:57:47.407ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1412026-11-03T05:57:48.611ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1422026-11-03T05:57:48.616ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1432026-11-03T05:57:48.618ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1442026-11-03T05:57:50.115ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1452026-11-03T05:57:50.119ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1462026-11-03T05:57:50.122ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1472026-11-03T05:57:51.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1482026-11-03T05:57:51.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1492026-11-03T05:57:51.425ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1502026-11-03T05:57:52.351ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1512026-11-03T05:57:52.356ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1522026-11-03T05:57:52.359ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1532026-11-03T05:57:53.541ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1542026-11-03T05:57:53.546ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1552026-11-03T05:57:53.549ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1562026-11-03T05:57:54.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572026-11-03T05:57:54.138ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1582026-11-03T05:57:54.141ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1592026-11-03T05:57:55.266ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602026-11-03T05:57:55.292ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1612026-11-03T05:57:55.303ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622026-11-03T05:57:55.674ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
1632026-11-03T05:57:56.348ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-11-03T05:57:56.357ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1652026-11-03T05:57:56.366ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1662026-11-03T05:57:56.651ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
1672026-11-03T05:57:57.043ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682026-11-03T05:57:57.052ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1692026-11-03T05:57:57.057ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1702026-11-03T05:57:57.600ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712026-11-03T05:57:57.608ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1722026-11-03T05:57:57.613ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1732026-11-03T05:57:57.838ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1742026-11-03T05:57:57.839ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 32.310469611s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1752026-11-03T05:57:58.981ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1762026-11-03T05:57:58.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1772026-11-03T05:57:58.987ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1782026-11-03T05:57:59.743ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1792026-11-03T05:57:59.751ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1802026-11-03T05:57:59.756ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1812026-11-03T05:58:00.237ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("126e41a8-8978-422f-b2e8-f23d26036d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("237b3f83-0799-4b9f-a7a2-b9db6e826569.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 622, tv_nsec: 69769066 } }) unit = producer-server
1822026-11-03T05:58:00.237ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1832026-11-03T05:58:00.253ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1842026-11-03T05:58:01.049ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1852026-11-03T05:58:01.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1862026-11-03T05:58:01.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1872026-11-03T05:58:01.664ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882026-11-03T05:58:01.669ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1892026-11-03T05:58:01.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1902026-11-03T05:58:02.362ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-11-03T05:58:02.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1922026-11-03T05:58:02.371ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932026-11-03T05:58:03.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-11-03T05:58:03.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1952026-11-03T05:58:03.227ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-11-03T05:58:04.042ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-11-03T05:58:04.046ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
1982026-11-03T05:58:04.048ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-11-03T05:58:05.404ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-11-03T05:58:05.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2012026-11-03T05:58:05.415ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-11-03T05:58:05.701ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
2032026-11-03T05:58:05.972ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-11-03T05:58:05.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2052026-11-03T05:58:05.981ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2062026-11-03T05:58:06.681ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
2072026-11-03T05:58:07.420ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2082026-11-03T05:58:07.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2092026-11-03T05:58:07.431ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2102026-11-03T05:58:08.336ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2112026-11-03T05:58:08.343ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2122026-11-03T05:58:08.348ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2132026-11-03T05:58:09.523ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2142026-11-03T05:58:09.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2152026-11-03T05:58:09.531ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2162026-11-03T05:58:10.831ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172026-11-03T05:58:10.836ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2182026-11-03T05:58:10.839ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2192026-11-03T05:58:11.643ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202026-11-03T05:58:11.648ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2212026-11-03T05:58:11.651ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2222026-11-03T05:58:13.019ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-11-03T05:58:13.023ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2242026-11-03T05:58:13.026ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2252026-11-03T05:58:13.751ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262026-11-03T05:58:13.756ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2272026-11-03T05:58:13.759ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2282026-11-03T05:58:15.252ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292026-11-03T05:58:15.257ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2302026-11-03T05:58:15.260ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2312026-11-03T05:58:15.274ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2322026-11-03T05:58:15.274ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 49.720126549s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2332026-11-03T05:58:15.708ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
2342026-11-03T05:58:16.653ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352026-11-03T05:58:16.657ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2362026-11-03T05:58:16.660ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2372026-11-03T05:58:16.685ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
2382026-11-03T05:58:17.227ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392026-11-03T05:58:17.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2402026-11-03T05:58:17.234ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2412026-11-03T05:58:18.210ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2422026-11-03T05:58:18.216ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2432026-11-03T05:58:18.220ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2442026-11-03T05:58:19.320ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2452026-11-03T05:58:19.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2462026-11-03T05:58:19.328ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2472026-11-03T05:58:19.736ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("126e41a8-8978-422f-b2e8-f23d26036d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("237b3f83-0799-4b9f-a7a2-b9db6e826569.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 641, tv_nsec: 549362234 } }) unit = producer-server
2482026-11-03T05:58:19.737ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2492026-11-03T05:58:19.742ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2502026-11-03T05:58:20.201ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2512026-11-03T05:58:20.205ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2522026-11-03T05:58:20.208ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2532026-11-03T05:58:21.336ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2542026-11-03T05:58:21.340ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2552026-11-03T05:58:21.343ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2562026-11-03T05:58:22.802ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2572026-11-03T05:58:22.808ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2582026-11-03T05:58:22.811ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2592026-11-03T05:58:23.938ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602026-11-03T05:58:23.943ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2612026-11-03T05:58:23.946ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622026-11-03T05:58:25.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632026-11-03T05:58:25.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2642026-11-03T05:58:25.400ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652026-11-03T05:58:25.709ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
2662026-11-03T05:58:26.686ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
2672026-11-03T05:58:26.714ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-11-03T05:58:26.718ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2692026-11-03T05:58:26.720ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2702026-11-03T05:58:27.287ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712026-11-03T05:58:27.292ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2722026-11-03T05:58:27.295ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2732026-11-03T05:58:28.434ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-11-03T05:58:28.439ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2752026-11-03T05:58:28.441ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762026-11-03T05:58:29.264ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-11-03T05:58:29.269ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2782026-11-03T05:58:29.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792026-11-03T05:58:30.399ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-11-03T05:58:30.404ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2812026-11-03T05:58:30.407ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-11-03T05:58:31.874ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-11-03T05:58:31.879ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2842026-11-03T05:58:31.882ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2852026-11-03T05:58:32.765ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-11-03T05:58:32.769ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2872026-11-03T05:58:32.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882026-11-03T05:58:33.559ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-11-03T05:58:33.567ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2902026-11-03T05:58:33.569ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2912026-11-03T05:58:34.741ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2922026-11-03T05:58:34.742ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 69.189368154s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2932026-11-03T05:58:34.863ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-11-03T05:58:34.867ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2952026-11-03T05:58:34.870ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-11-03T05:58:35.710ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
2972026-11-03T05:58:35.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-11-03T05:58:35.725ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
2992026-11-03T05:58:35.727ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3002026-11-03T05:58:36.375ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-11-03T05:58:36.384ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3022026-11-03T05:58:36.387ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3032026-11-03T05:58:36.686ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
3042026-11-03T05:58:37.506ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052026-11-03T05:58:37.511ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3062026-11-03T05:58:37.514ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3072026-11-03T05:58:38.489ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3082026-11-03T05:58:38.493ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3092026-11-03T05:58:38.497ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3102026-11-03T05:58:38.791ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("126e41a8-8978-422f-b2e8-f23d26036d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("237b3f83-0799-4b9f-a7a2-b9db6e826569.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 660, tv_nsec: 606446551 } }) unit = producer-server
3112026-11-03T05:58:38.791ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3122026-11-03T05:58:38.798ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3132026-11-03T05:58:39.136ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3142026-11-03T05:58:39.139ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3152026-11-03T05:58:39.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3162026-11-03T05:58:40.332ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3172026-11-03T05:58:40.336ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3182026-11-03T05:58:40.338ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3192026-11-03T05:58:41.425ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3202026-11-03T05:58:41.430ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3212026-11-03T05:58:41.433ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3222026-11-03T05:58:42.045ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3232026-11-03T05:58:42.049ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3242026-11-03T05:58:42.052ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3252026-11-03T05:58:42.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262026-11-03T05:58:42.663ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3272026-11-03T05:58:42.666ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3282026-11-03T05:58:43.564ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292026-11-03T05:58:43.569ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3302026-11-03T05:58:43.572ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3312026-11-03T05:58:44.540ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-11-03T05:58:44.545ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3332026-11-03T05:58:44.549ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342026-11-03T05:58:45.711ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
3352026-11-03T05:58:46.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3362026-11-03T05:58:46.039ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3372026-11-03T05:58:46.043ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3382026-11-03T05:58:46.688ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
3392026-11-03T05:58:46.773ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-11-03T05:58:46.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3412026-11-03T05:58:46.782ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-11-03T05:58:48.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-11-03T05:58:48.181ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3442026-11-03T05:58:48.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3452026-11-03T05:58:49.588ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-11-03T05:58:49.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3472026-11-03T05:58:49.596ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3482026-11-03T05:58:50.189ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-11-03T05:58:50.194ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3502026-11-03T05:58:50.197ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-11-03T05:58:51.636ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-11-03T05:58:51.641ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3532026-11-03T05:58:51.644ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3542026-11-03T05:58:52.346ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-11-03T05:58:52.352ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3562026-11-03T05:58:52.354ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3572026-11-03T05:58:53.799ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3582026-11-03T05:58:53.800ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 88.248231346s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3592026-11-03T05:58:53.817ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-11-03T05:58:53.821ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3612026-11-03T05:58:53.823ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622026-11-03T05:58:54.960ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-11-03T05:58:54.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3642026-11-03T05:58:54.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652026-11-03T05:58:55.713ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
3662026-11-03T05:58:56.365ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-11-03T05:58:56.370ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3682026-11-03T05:58:56.373ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3692026-11-03T05:58:56.690ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
3702026-11-03T05:58:56.988ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712026-11-03T05:58:56.992ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3722026-11-03T05:58:56.995ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3732026-11-03T05:58:58.120ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3742026-11-03T05:58:58.124ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3752026-11-03T05:58:58.127ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3762026-11-03T05:58:59.299ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3772026-11-03T05:58:59.306ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3782026-11-03T05:58:59.310ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3792026-11-03T05:58:59.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802026-11-03T05:58:59.837ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3812026-11-03T05:58:59.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822026-11-03T05:59:00.704ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832026-11-03T05:59:00.709ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3842026-11-03T05:59:00.712ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3852026-11-03T05:59:01.908ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862026-11-03T05:59:01.913ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3872026-11-03T05:59:01.916ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3882026-11-03T05:59:02.265ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("126e41a8-8978-422f-b2e8-f23d26036d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("237b3f83-0799-4b9f-a7a2-b9db6e826569.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 684, tv_nsec: 81107376 } }) unit = producer-server
3892026-11-03T05:59:02.266ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3902026-11-03T05:59:02.272ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3912026-11-03T05:59:03.182ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922026-11-03T05:59:03.191ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3932026-11-03T05:59:03.198ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3942026-11-03T05:59:12.111ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952026-11-03T05:59:12.142ZINFOtfportd: removed stale NDP entry :fe80::54c3:aff:fe53:f870->56:c3:0a:53:f8:70
3962026-11-03T05:59:12.174ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
3972026-11-03T05:59:12.176ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
3982026-11-03T05:59:12.178ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
3992026-11-03T05:59:12.198ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4002026-11-03T05:59:12.874ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::54c3:aff:fe53:f870->56:c3:0a:53:f8:70 interface = tfportrear0_0
4012026-11-03T05:59:13.422ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-11-03T05:59:13.429ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4032026-11-03T05:59:13.433ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042026-11-03T05:59:14.087ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4052026-11-03T05:59:14.109ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4062026-11-03T05:59:14.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4072026-11-03T05:59:15.311ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082026-11-03T05:59:15.336ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4092026-11-03T05:59:15.347ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102026-11-03T05:59:17.898ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4112026-11-03T05:59:17.947ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-11-03T05:59:17.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4132026-11-03T05:59:17.987ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4142026-11-03T05:59:18.005ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 112.452500291s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4152026-11-03T05:59:19.371ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4162026-11-03T05:59:19.379ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4172026-11-03T05:59:19.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4182026-11-03T05:59:20.168ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4192026-11-03T05:59:20.174ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4202026-11-03T05:59:20.179ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4212026-11-03T05:59:21.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4222026-11-03T05:59:21.666ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4232026-11-03T05:59:21.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4242026-11-03T05:59:22.682ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
4252026-11-03T05:59:22.685ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
4262026-11-03T05:59:22.845ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-11-03T05:59:22.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4282026-11-03T05:59:22.855ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292026-11-03T05:59:22.915ZINFOtfportd: removed stale NDP entry :fe80::54c3:aff:fe53:f870->56:c3:0a:53:f8:70
4302026-11-03T05:59:23.954ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::54c3:aff:fe53:f870->56:c3:0a:53:f8:70 interface = tfportrear0_0
4312026-11-03T05:59:24.304ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4322026-11-03T05:59:24.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4332026-11-03T05:59:24.315ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4342026-11-03T05:59:25.594ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4352026-11-03T05:59:25.601ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4362026-11-03T05:59:25.604ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4372026-11-03T05:59:26.851ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4382026-11-03T05:59:26.856ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4392026-11-03T05:59:26.859ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4402026-11-03T05:59:28.240ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4412026-11-03T05:59:28.251ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4422026-11-03T05:59:28.254ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4432026-11-03T05:59:29.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-11-03T05:59:29.180ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4452026-11-03T05:59:29.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4462026-11-03T05:59:30.323ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-11-03T05:59:30.328ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4482026-11-03T05:59:30.331ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-11-03T05:59:31.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-11-03T05:59:31.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4512026-11-03T05:59:31.227ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522026-11-03T05:59:31.849ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-11-03T05:59:31.854ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4542026-11-03T05:59:31.858ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4552026-11-03T05:59:32.687ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
4562026-11-03T05:59:32.688ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
4572026-11-03T05:59:32.904ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4582026-11-03T05:59:32.909ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4592026-11-03T05:59:32.912ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4602026-11-03T05:59:33.650ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4612026-11-03T05:59:33.657ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4622026-11-03T05:59:33.661ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4632026-11-03T05:59:35.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4642026-11-03T05:59:35.079ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4652026-11-03T05:59:35.083ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4662026-11-03T05:59:36.550ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672026-11-03T05:59:36.556ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4682026-11-03T05:59:36.560ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4692026-11-03T05:59:37.116ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702026-11-03T05:59:37.125ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4712026-11-03T05:59:37.128ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4722026-11-03T05:59:38.577ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732026-11-03T05:59:38.584ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4742026-11-03T05:59:38.594ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4752026-11-03T05:59:39.950ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762026-11-03T05:59:39.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4772026-11-03T05:59:39.958ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4782026-11-03T05:59:40.795ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792026-11-03T05:59:40.801ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4802026-11-03T05:59:40.804ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4812026-11-03T05:59:41.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822026-11-03T05:59:41.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4832026-11-03T05:59:41.423ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842026-11-03T05:59:42.079ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852026-11-03T05:59:42.088ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4862026-11-03T05:59:42.091ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872026-11-03T05:59:42.693ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
4882026-11-03T05:59:42.693ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
4892026-11-03T05:59:43.229ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-11-03T05:59:43.239ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4912026-11-03T05:59:43.244ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4922026-11-03T05:59:44.085ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-11-03T05:59:44.092ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
4942026-11-03T05:59:44.096ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4952026-11-03T05:59:44.715ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("126e41a8-8978-422f-b2e8-f23d26036d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("237b3f83-0799-4b9f-a7a2-b9db6e826569.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9acb4469-afda-4572-85ad-d5749073cc20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 726, tv_nsec: 529044997 } }) unit = producer-server
4962026-11-03T05:59:44.717ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4972026-11-03T05:59:44.752ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4982026-11-03T05:59:44.756ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
4992026-11-03T05:59:44.757ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 8 delay = 139.203296253s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
5002026-11-03T05:59:44.766ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5012026-11-03T05:59:44.775ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5022026-11-03T05:59:44.779ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5032026-11-03T05:59:46.084ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5042026-11-03T05:59:46.090ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5052026-11-03T05:59:46.093ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5062026-11-03T05:59:46.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-11-03T05:59:46.828ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5082026-11-03T05:59:46.830ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5092026-11-03T05:59:47.777ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-11-03T05:59:47.782ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5112026-11-03T05:59:47.784ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5122026-11-03T05:59:48.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-11-03T05:59:48.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5142026-11-03T05:59:48.649ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5152026-11-03T05:59:49.449ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-11-03T05:59:49.454ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5172026-11-03T05:59:49.458ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5182026-11-03T05:59:50.595ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192026-11-03T05:59:50.601ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5202026-11-03T05:59:50.604ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5212026-11-03T05:59:51.495ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-11-03T05:59:51.502ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5232026-11-03T05:59:51.506ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242026-11-03T05:59:52.697ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9836045021275666531 n_samples = 6 unit = oximeter
5252026-11-03T05:59:52.697ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7285793101736310781 n_samples = 6 unit = oximeter
5262026-11-03T05:59:52.722ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5272026-11-03T05:59:52.727ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5282026-11-03T05:59:52.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5292026-11-03T05:59:54.152ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5302026-11-03T05:59:54.157ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5312026-11-03T05:59:54.160ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5322026-11-03T05:59:55.088ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5332026-11-03T05:59:55.094ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5342026-11-03T05:59:55.097ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5352026-11-03T05:59:55.863ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5362026-11-03T05:59:55.869ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5372026-11-03T05:59:55.872ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5382026-11-03T05:59:57.150ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-11-03T05:59:57.156ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5402026-11-03T05:59:57.159ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5412026-11-03T05:59:58.374ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-11-03T05:59:58.379ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5432026-11-03T05:59:58.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5442026-11-03T05:59:59.747ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5452026-11-03T05:59:59.752ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5462026-11-03T05:59:59.754ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5472026-11-03T06:00:00.861ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5482026-11-03T06:00:00.871ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5492026-11-03T06:00:00.876ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5502026-11-03T06:00:01.507ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5512026-11-03T06:00:01.516ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::5493:3fff:fe3c:5aba]
5522026-11-03T06:00:01.521ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]