Max level shown:
1 [ Mar 18 23:11:15 Enabled. ]
2 [ Mar 18 23:11:15 Rereading configuration. ]
3 [ Mar 18 23:11:17 Rereading configuration. ]
4 [ Mar 18 23:11:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Mar 18 23:11:28 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-03-18T23:11:28.263ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-03-18T23:11:28.265ZINFOtfportd: connected to dpd running softnpu-b31ba90d
92026-03-18T23:11:28.265ZINFOtfportd: running in sync-only mode
102026-03-18T23:11:28.265ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-03-18T23:11:28.267ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-03-18T23:11:28.271ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( e8f0db9c-eede-43bc-ad84-05a747909ff6, ), sled_id: Some( 1ca1b0d9-8ea0-457a-aa20-db3c544c80f1, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-03-18T23:11:28.271ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-03-18T23:11:28.275ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
162026-03-18T23:11:28.276ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::6017:deff:fe56:386f->62:17:de:56:38:6f interface = tfportrear0_0
172026-03-18T23:11:28.276ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::b415:98ff:feb7:b04c->b6:15:98:b7:b0:4c interface = tfportrear0_0
182026-03-18T23:11:28.281ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
192026-03-18T23:11:28.287ZWARNtfportd: tfportqsfp0_0 has no addrs
20 [ Mar 18 23:11:28 Rereading configuration. ]
21 [ Mar 18 23:11:28 Executing refresh method (:kill). ]
22 [ Mar 18 23:11:28 Stopping because all processes in service exited. ]
23 [ Mar 18 23:11:28 Executing stop method (:kill). ]
24 [ Mar 18 23:11:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ Mar 18 23:11:28 Method "start" exited with status 0. ]
262026-03-18T23:11:28.949ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272026-03-18T23:11:28.950ZINFOtfportd: connected to dpd running softnpu-b31ba90d
282026-03-18T23:11:28.951ZINFOtfportd: running in sync-only mode
292026-03-18T23:11:28.951ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302026-03-18T23:11:28.952ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312026-03-18T23:11:28.952ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: e8f0db9c-eede-43bc-ad84-05a747909ff6, sled_id: 1ca1b0d9-8ea0-457a-aa20-db3c544c80f1, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 7827ca0f-cf27-479a-afe9-b5ff39f8bb10, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322026-03-18T23:11:28.952ZDEBGtfportd: created producer ID producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 unit = oximeter
332026-03-18T23:11:28.954ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( e8f0db9c-eede-43bc-ad84-05a747909ff6, ), sled_id: Some( 1ca1b0d9-8ea0-457a-aa20-db3c544c80f1, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
342026-03-18T23:11:28.959ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352026-03-18T23:11:28.961ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::6017:deff:fe56:386f->62:17:de:56:38:6f interface = tfportrear0_0
362026-03-18T23:11:28.962ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::b415:98ff:feb7:b04c->b6:15:98:b7:b0:4c interface = tfportrear0_0
372026-03-18T23:11:28.963ZDEBGtfportd: registered DTrace probes unit = producer-server
382026-03-18T23:11:28.964ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:42937 method = GET path = /{producer_id} unit = producer-server versions = all
392026-03-18T23:11:28.964ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:42937 unit = producer-server
402026-03-18T23:11:28.964ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:42937 unit = producer-server
412026-03-18T23:11:28.964ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:42937 unit = producer-server
422026-03-18T23:11:28.964ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-03-18T23:11:28.964ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442026-03-18T23:11:28.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
452026-03-18T23:11:28.965ZDEBGtfportd: starting producer registration task unit = producer-server
462026-03-18T23:11:28.965ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:42937 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 unit = producer-server
472026-03-18T23:11:28.965ZINFOtfportd: created oximeter producer server unit = oximeter
482026-03-18T23:11:28.965ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
492026-03-18T23:11:28.965ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
502026-03-18T23:11:28.966ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-03-18T23:11:12.084163241Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512026-03-18T23:11:28.966ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 11755012570516092394 unit = oximeter
522026-03-18T23:11:28.966ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532026-03-18T23:11:28.968ZWARNtfportd: tfportqsfp0_0 has no addrs
542026-03-18T23:11:29.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552026-03-18T23:11:29.811ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
562026-03-18T23:11:29.814ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
572026-03-18T23:11:29.815ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582026-03-18T23:11:29.815ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-03-18T23:11:12.084026739Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592026-03-18T23:11:29.815ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 17914078982432279797 unit = oximeter
602026-03-18T23:11:29.815ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612026-03-18T23:11:29.996ZINFOtfportd: added new ARP entry entry = 10.151.2.174->fa:b6:73:49:9e:1b interface = tfportqsfp0_0
622026-03-18T23:11:30.970ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
632026-03-18T23:11:30.977ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
642026-03-18T23:11:30.981ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
652026-03-18T23:11:31.582ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662026-03-18T23:11:31.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
672026-03-18T23:11:31.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
682026-03-18T23:11:32.288ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692026-03-18T23:11:32.293ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
702026-03-18T23:11:32.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
712026-03-18T23:11:32.877ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
722026-03-18T23:11:32.881ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
732026-03-18T23:11:32.884ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
742026-03-18T23:11:33.968ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 680, tv_nsec: 29240064 } }) unit = producer-server
752026-03-18T23:11:33.968ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
762026-03-18T23:11:34.011ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
772026-03-18T23:11:34.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-03-18T23:11:34.040ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
792026-03-18T23:11:34.042ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
802026-03-18T23:11:35.067ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812026-03-18T23:11:35.072ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
822026-03-18T23:11:35.075ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
832026-03-18T23:11:36.027ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842026-03-18T23:11:36.032ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
852026-03-18T23:11:36.034ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
862026-03-18T23:11:36.901ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-03-18T23:11:36.906ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
882026-03-18T23:11:36.908ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
892026-03-18T23:11:37.594ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-03-18T23:11:37.598ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
912026-03-18T23:11:37.601ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
922026-03-18T23:11:38.972ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
932026-03-18T23:11:38.996ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-03-18T23:11:39.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
952026-03-18T23:11:39.004ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
962026-03-18T23:11:39.816ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
972026-03-18T23:11:39.817ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982026-03-18T23:11:39.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
992026-03-18T23:11:39.826ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1002026-03-18T23:11:40.467ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012026-03-18T23:11:40.472ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1022026-03-18T23:11:40.475ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1032026-03-18T23:11:41.730ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042026-03-18T23:11:41.735ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1052026-03-18T23:11:41.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1062026-03-18T23:11:42.494ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072026-03-18T23:11:42.498ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1082026-03-18T23:11:42.502ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1092026-03-18T23:11:43.141ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-03-18T23:11:43.147ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1112026-03-18T23:11:43.150ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1122026-03-18T23:11:43.835ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132026-03-18T23:11:43.839ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1142026-03-18T23:11:43.842ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1152026-03-18T23:11:44.693ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162026-03-18T23:11:44.697ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1172026-03-18T23:11:44.700ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1182026-03-18T23:11:45.944ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192026-03-18T23:11:45.948ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1202026-03-18T23:11:45.951ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1212026-03-18T23:11:46.707ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1222026-03-18T23:11:46.714ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1232026-03-18T23:11:46.717ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1242026-03-18T23:11:47.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-03-18T23:11:47.508ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1262026-03-18T23:11:47.510ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1272026-03-18T23:11:48.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-03-18T23:11:48.206ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1292026-03-18T23:11:48.210ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1302026-03-18T23:11:48.976ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
1312026-03-18T23:11:49.014ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1322026-03-18T23:11:49.015ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.048315179s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1332026-03-18T23:11:49.158ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 695, tv_nsec: 217402291 } }) unit = producer-server
1342026-03-18T23:11:49.158ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1352026-03-18T23:11:49.193ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1362026-03-18T23:11:49.397ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-03-18T23:11:49.403ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1382026-03-18T23:11:49.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392026-03-18T23:11:49.950ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
1402026-03-18T23:11:50.275ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412026-03-18T23:11:50.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1422026-03-18T23:11:50.331ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1432026-03-18T23:11:53.152ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-03-18T23:11:53.163ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1452026-03-18T23:11:53.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1462026-03-18T23:11:54.597ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-03-18T23:11:54.601ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1482026-03-18T23:11:54.605ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1492026-03-18T23:11:55.829ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-03-18T23:11:55.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1512026-03-18T23:11:55.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1522026-03-18T23:11:56.470ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-03-18T23:11:56.474ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1542026-03-18T23:11:56.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1552026-03-18T23:11:56.994ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562026-03-18T23:11:56.998ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1572026-03-18T23:11:57.001ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1582026-03-18T23:11:57.638ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592026-03-18T23:11:57.643ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1602026-03-18T23:11:57.646ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1612026-03-18T23:11:58.361ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1622026-03-18T23:11:58.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1632026-03-18T23:11:58.369ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1642026-03-18T23:11:58.990ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
1652026-03-18T23:11:59.855ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662026-03-18T23:11:59.861ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1672026-03-18T23:11:59.864ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1682026-03-18T23:11:59.952ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
1692026-03-18T23:12:01.023ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1702026-03-18T23:12:04.623ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1712026-03-18T23:12:04.671ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1722026-03-18T23:12:04.719ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1732026-03-18T23:12:05.085ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 36.118001163s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1742026-03-18T23:12:05.903ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752026-03-18T23:12:05.911ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1762026-03-18T23:12:05.915ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1772026-03-18T23:12:07.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782026-03-18T23:12:07.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1792026-03-18T23:12:07.202ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1802026-03-18T23:12:07.233ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 713, tv_nsec: 291570919 } }) unit = producer-server
1812026-03-18T23:12:07.267ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1822026-03-18T23:12:07.597ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1832026-03-18T23:12:08.248ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-03-18T23:12:08.255ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1852026-03-18T23:12:08.259ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1862026-03-18T23:12:08.918ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872026-03-18T23:12:08.924ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1882026-03-18T23:12:08.927ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1892026-03-18T23:12:09.012ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
1902026-03-18T23:12:09.542ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-03-18T23:12:09.548ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1922026-03-18T23:12:09.551ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1932026-03-18T23:12:09.954ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
1942026-03-18T23:12:10.425ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952026-03-18T23:12:10.430ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1962026-03-18T23:12:10.433ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1972026-03-18T23:12:11.300ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1982026-03-18T23:12:11.306ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
1992026-03-18T23:12:11.311ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2002026-03-18T23:12:12.807ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012026-03-18T23:12:12.812ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2022026-03-18T23:12:12.815ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2032026-03-18T23:12:13.725ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-03-18T23:12:13.730ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2052026-03-18T23:12:13.761ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2062026-03-18T23:12:14.518ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072026-03-18T23:12:14.524ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2082026-03-18T23:12:14.527ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2092026-03-18T23:12:15.405ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102026-03-18T23:12:15.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2112026-03-18T23:12:15.414ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2122026-03-18T23:12:16.428ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132026-03-18T23:12:16.434ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2142026-03-18T23:12:16.437ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2152026-03-18T23:12:17.127ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162026-03-18T23:12:17.133ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2172026-03-18T23:12:17.136ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2182026-03-18T23:12:18.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192026-03-18T23:12:18.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2202026-03-18T23:12:18.080ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2212026-03-18T23:12:19.032ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
2222026-03-18T23:12:19.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-03-18T23:12:19.315ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2242026-03-18T23:12:19.318ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2252026-03-18T23:12:19.956ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
2262026-03-18T23:12:20.424ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2272026-03-18T23:12:20.430ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2282026-03-18T23:12:20.433ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2292026-03-18T23:12:21.173ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2302026-03-18T23:12:21.178ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2312026-03-18T23:12:21.182ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2322026-03-18T23:12:22.270ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2332026-03-18T23:12:22.275ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2342026-03-18T23:12:22.278ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2352026-03-18T23:12:22.598ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2362026-03-18T23:12:22.599ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 53.632153192s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2372026-03-18T23:12:23.118ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382026-03-18T23:12:23.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2392026-03-18T23:12:23.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2402026-03-18T23:12:23.363ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 729, tv_nsec: 421896930 } }) unit = producer-server
2412026-03-18T23:12:23.363ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2422026-03-18T23:12:23.396ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2432026-03-18T23:12:23.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2442026-03-18T23:12:23.785ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2452026-03-18T23:12:23.788ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2462026-03-18T23:12:24.414ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2472026-03-18T23:12:24.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2482026-03-18T23:12:24.422ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2492026-03-18T23:12:25.384ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-03-18T23:12:25.390ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2512026-03-18T23:12:25.393ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2522026-03-18T23:12:26.128ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2532026-03-18T23:12:26.133ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2542026-03-18T23:12:26.136ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2552026-03-18T23:12:27.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562026-03-18T23:12:27.225ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2572026-03-18T23:12:27.228ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2582026-03-18T23:12:28.506ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592026-03-18T23:12:28.512ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2602026-03-18T23:12:28.515ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2612026-03-18T23:12:29.034ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
2622026-03-18T23:12:29.940ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632026-03-18T23:12:29.946ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2642026-03-18T23:12:29.949ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2652026-03-18T23:12:29.958ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
2662026-03-18T23:12:31.098ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672026-03-18T23:12:31.103ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2682026-03-18T23:12:31.106ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2692026-03-18T23:12:32.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702026-03-18T23:12:32.191ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2712026-03-18T23:12:32.195ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2722026-03-18T23:12:33.654ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2732026-03-18T23:12:33.659ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2742026-03-18T23:12:33.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2752026-03-18T23:12:34.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2762026-03-18T23:12:34.511ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2772026-03-18T23:12:34.514ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2782026-03-18T23:12:35.413ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2792026-03-18T23:12:35.418ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2802026-03-18T23:12:35.422ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2812026-03-18T23:12:36.300ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822026-03-18T23:12:36.305ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2832026-03-18T23:12:36.308ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2842026-03-18T23:12:37.800ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2852026-03-18T23:12:37.806ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2862026-03-18T23:12:37.810ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2872026-03-18T23:12:38.334ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2882026-03-18T23:12:38.340ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2892026-03-18T23:12:38.343ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2902026-03-18T23:12:38.397ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2912026-03-18T23:12:38.399ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 69.431557222s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2922026-03-18T23:12:38.865ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2932026-03-18T23:12:38.870ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2942026-03-18T23:12:38.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2952026-03-18T23:12:39.036ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
2962026-03-18T23:12:39.959ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
2972026-03-18T23:12:40.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-03-18T23:12:40.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
2992026-03-18T23:12:40.044ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3002026-03-18T23:12:40.641ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-03-18T23:12:40.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3022026-03-18T23:12:40.650ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3032026-03-18T23:12:41.339ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 747, tv_nsec: 398847137 } }) unit = producer-server
3042026-03-18T23:12:41.340ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3052026-03-18T23:12:41.373ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3062026-03-18T23:12:41.630ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3072026-03-18T23:12:41.635ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3082026-03-18T23:12:41.639ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3092026-03-18T23:12:42.409ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3102026-03-18T23:12:42.415ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3112026-03-18T23:12:42.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3122026-03-18T23:12:43.379ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3132026-03-18T23:12:43.385ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3142026-03-18T23:12:43.388ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3152026-03-18T23:12:43.937ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3162026-03-18T23:12:43.943ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3172026-03-18T23:12:43.946ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3182026-03-18T23:12:45.068ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3192026-03-18T23:12:45.074ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3202026-03-18T23:12:45.077ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3212026-03-18T23:12:46.481ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222026-03-18T23:12:46.486ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3232026-03-18T23:12:46.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3242026-03-18T23:12:47.131ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252026-03-18T23:12:47.136ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3262026-03-18T23:12:47.139ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3272026-03-18T23:12:47.960ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3282026-03-18T23:12:47.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3292026-03-18T23:12:47.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3302026-03-18T23:12:49.037ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
3312026-03-18T23:12:49.066ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-03-18T23:12:49.072ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3332026-03-18T23:12:49.075ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3342026-03-18T23:12:49.960ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
3352026-03-18T23:12:50.332ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3362026-03-18T23:12:50.338ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3372026-03-18T23:12:50.341ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3382026-03-18T23:12:51.445ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3392026-03-18T23:12:51.450ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3402026-03-18T23:12:51.453ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3412026-03-18T23:12:52.019ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3422026-03-18T23:12:52.024ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3432026-03-18T23:12:52.027ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3442026-03-18T23:12:53.118ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452026-03-18T23:12:53.124ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3462026-03-18T23:12:53.127ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3472026-03-18T23:12:54.010ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482026-03-18T23:12:54.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3492026-03-18T23:12:54.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3502026-03-18T23:12:54.626ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512026-03-18T23:12:54.632ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3522026-03-18T23:12:54.635ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3532026-03-18T23:12:56.127ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542026-03-18T23:12:56.133ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3552026-03-18T23:12:56.136ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3562026-03-18T23:12:56.375ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3572026-03-18T23:12:56.376ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 87.409454383s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3582026-03-18T23:12:57.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3592026-03-18T23:12:57.598ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3602026-03-18T23:12:57.601ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3612026-03-18T23:12:58.839ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 764, tv_nsec: 898467360 } }) unit = producer-server
3622026-03-18T23:12:58.839ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3632026-03-18T23:12:58.872ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3642026-03-18T23:12:59.013ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3652026-03-18T23:12:59.018ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3662026-03-18T23:12:59.021ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3672026-03-18T23:12:59.039ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
3682026-03-18T23:12:59.962ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
3692026-03-18T23:13:00.167ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3702026-03-18T23:13:00.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3712026-03-18T23:13:00.180ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3722026-03-18T23:13:01.490ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3732026-03-18T23:13:01.498ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3742026-03-18T23:13:01.502ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3752026-03-18T23:13:02.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762026-03-18T23:13:02.284ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3772026-03-18T23:13:02.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3782026-03-18T23:13:03.247ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3792026-03-18T23:13:03.252ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3802026-03-18T23:13:03.255ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3812026-03-18T23:13:04.416ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3822026-03-18T23:13:04.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3832026-03-18T23:13:04.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3842026-03-18T23:13:05.757ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852026-03-18T23:13:05.762ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3862026-03-18T23:13:05.765ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3872026-03-18T23:13:06.852ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882026-03-18T23:13:06.858ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3892026-03-18T23:13:06.861ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3902026-03-18T23:13:07.578ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912026-03-18T23:13:07.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3922026-03-18T23:13:07.586ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3932026-03-18T23:13:08.859ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3942026-03-18T23:13:08.863ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
3952026-03-18T23:13:08.867ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3962026-03-18T23:13:09.042ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
3972026-03-18T23:13:09.963ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
3982026-03-18T23:13:10.165ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-03-18T23:13:10.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4002026-03-18T23:13:10.173ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4012026-03-18T23:13:11.198ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-03-18T23:13:11.202ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4032026-03-18T23:13:11.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4042026-03-18T23:13:12.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4052026-03-18T23:13:12.525ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4062026-03-18T23:13:12.532ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4072026-03-18T23:13:13.759ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082026-03-18T23:13:13.765ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4092026-03-18T23:13:13.769ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4102026-03-18T23:13:13.868ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4112026-03-18T23:13:13.869ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 104.907392563s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4122026-03-18T23:13:14.895ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4132026-03-18T23:13:14.902ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4142026-03-18T23:13:14.906ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4152026-03-18T23:13:25.927ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
4162026-03-18T23:13:25.931ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
4172026-03-18T23:13:25.947ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-03-18T23:13:26.088ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 792, tv_nsec: 123024245 } }) unit = producer-server
4192026-03-18T23:13:26.099ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4202026-03-18T23:13:26.100ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4212026-03-18T23:13:26.533ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4222026-03-18T23:13:26.550ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4232026-03-18T23:13:27.845ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-03-18T23:13:27.852ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4252026-03-18T23:13:27.860ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4262026-03-18T23:13:29.109ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-03-18T23:13:29.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4282026-03-18T23:13:29.122ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4292026-03-18T23:13:30.537ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-03-18T23:13:30.551ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4312026-03-18T23:13:30.557ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4322026-03-18T23:13:31.381ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-03-18T23:13:31.394ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4342026-03-18T23:13:31.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4352026-03-18T23:13:32.099ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362026-03-18T23:13:32.105ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4372026-03-18T23:13:32.109ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4382026-03-18T23:13:32.653ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4392026-03-18T23:13:32.660ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4402026-03-18T23:13:32.664ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4412026-03-18T23:13:33.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4422026-03-18T23:13:33.817ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4432026-03-18T23:13:33.826ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4442026-03-18T23:13:34.828ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4452026-03-18T23:13:34.835ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4462026-03-18T23:13:34.839ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4472026-03-18T23:13:35.433ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4482026-03-18T23:13:35.440ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4492026-03-18T23:13:35.444ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4502026-03-18T23:13:35.931ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
4512026-03-18T23:13:35.933ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
4522026-03-18T23:13:36.578ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-03-18T23:13:36.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4542026-03-18T23:13:36.592ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4552026-03-18T23:13:37.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-03-18T23:13:37.343ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4572026-03-18T23:13:37.346ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4582026-03-18T23:13:38.434ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-03-18T23:13:38.449ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4602026-03-18T23:13:38.452ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4612026-03-18T23:13:39.440ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-03-18T23:13:39.445ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4632026-03-18T23:13:39.448ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4642026-03-18T23:13:40.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-03-18T23:13:40.812ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4662026-03-18T23:13:40.815ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4672026-03-18T23:13:41.535ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4682026-03-18T23:13:41.539ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 132.576395222s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4692026-03-18T23:13:42.163ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702026-03-18T23:13:42.168ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4712026-03-18T23:13:42.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4722026-03-18T23:13:42.981ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732026-03-18T23:13:42.986ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4742026-03-18T23:13:42.989ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4752026-03-18T23:13:43.757ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762026-03-18T23:13:43.762ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4772026-03-18T23:13:43.766ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4782026-03-18T23:13:44.755ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792026-03-18T23:13:44.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4802026-03-18T23:13:44.763ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4812026-03-18T23:13:45.942ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
4822026-03-18T23:13:45.943ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
4832026-03-18T23:13:46.012ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-03-18T23:13:46.018ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4852026-03-18T23:13:46.021ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4862026-03-18T23:13:47.123ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-03-18T23:13:47.129ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4882026-03-18T23:13:47.132ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4892026-03-18T23:13:48.516ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-03-18T23:13:48.521ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4912026-03-18T23:13:48.524ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4922026-03-18T23:13:49.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-03-18T23:13:49.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4942026-03-18T23:13:49.130ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4952026-03-18T23:13:50.106ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-03-18T23:13:50.111ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
4972026-03-18T23:13:50.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4982026-03-18T23:13:51.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-03-18T23:13:51.211ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5002026-03-18T23:13:51.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5012026-03-18T23:13:51.793ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 817, tv_nsec: 858061643 } }) unit = producer-server
5022026-03-18T23:13:51.794ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
5032026-03-18T23:13:51.837ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
5042026-03-18T23:13:51.840ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
5052026-03-18T23:13:51.840ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 142.878796796s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
5062026-03-18T23:13:52.493ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-03-18T23:13:52.499ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5082026-03-18T23:13:52.502ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5092026-03-18T23:13:53.198ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-03-18T23:13:53.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5112026-03-18T23:13:53.208ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5122026-03-18T23:13:54.379ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-03-18T23:13:54.384ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5142026-03-18T23:13:54.388ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5152026-03-18T23:13:55.322ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-03-18T23:13:55.328ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5172026-03-18T23:13:55.332ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5182026-03-18T23:13:55.946ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
5192026-03-18T23:13:55.946ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
5202026-03-18T23:13:56.836ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5212026-03-18T23:13:56.844ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5222026-03-18T23:13:56.848ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5232026-03-18T23:13:58.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5242026-03-18T23:13:58.347ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5252026-03-18T23:13:58.351ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5262026-03-18T23:13:59.580ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5272026-03-18T23:13:59.586ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5282026-03-18T23:13:59.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5292026-03-18T23:14:01.103ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5302026-03-18T23:14:01.109ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5312026-03-18T23:14:01.112ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5322026-03-18T23:14:02.113ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5332026-03-18T23:14:02.121ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5342026-03-18T23:14:02.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5352026-03-18T23:14:03.469ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5362026-03-18T23:14:03.475ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5372026-03-18T23:14:03.478ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5382026-03-18T23:14:04.915ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-03-18T23:14:04.922ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5402026-03-18T23:14:04.935ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5412026-03-18T23:14:05.946ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-03-18T23:14:05.950ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
5432026-03-18T23:14:05.951ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
5442026-03-18T23:14:05.954ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5452026-03-18T23:14:05.957ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5462026-03-18T23:14:07.427ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5472026-03-18T23:14:07.434ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5482026-03-18T23:14:07.437ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5492026-03-18T23:14:08.196ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5502026-03-18T23:14:08.203ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5512026-03-18T23:14:08.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5522026-03-18T23:14:09.366ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5532026-03-18T23:14:09.372ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5542026-03-18T23:14:09.375ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5552026-03-18T23:14:10.491ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5562026-03-18T23:14:10.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5572026-03-18T23:14:10.500ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5582026-03-18T23:14:11.326ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5592026-03-18T23:14:11.333ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5602026-03-18T23:14:11.337ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5612026-03-18T23:14:12.599ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5622026-03-18T23:14:12.605ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5632026-03-18T23:14:12.608ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5642026-03-18T23:14:13.731ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5652026-03-18T23:14:13.738ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5662026-03-18T23:14:13.741ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5672026-03-18T23:14:14.910ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5682026-03-18T23:14:14.917ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5692026-03-18T23:14:14.921ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5702026-03-18T23:14:15.653ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5712026-03-18T23:14:15.658ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5722026-03-18T23:14:15.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5732026-03-18T23:14:15.954ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
5742026-03-18T23:14:15.954ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
5752026-03-18T23:14:16.867ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5762026-03-18T23:14:16.872ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5772026-03-18T23:14:16.876ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5782026-03-18T23:14:17.911ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5792026-03-18T23:14:17.916ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5802026-03-18T23:14:17.919ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5812026-03-18T23:14:19.137ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5822026-03-18T23:14:19.143ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5832026-03-18T23:14:19.146ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5842026-03-18T23:14:20.357ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5852026-03-18T23:14:20.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5862026-03-18T23:14:20.371ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5872026-03-18T23:14:21.260ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5882026-03-18T23:14:21.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5892026-03-18T23:14:21.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5902026-03-18T23:14:22.237ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("169680fd-400d-4d9a-8dd1-1eab246fac7b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c7bbc88-6895-4a8f-a275-98e5df74c02b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ed2aed47-f376-40c3-ad9f-8583ac6eb363.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 848, tv_nsec: 302392024 } }) unit = producer-server
5912026-03-18T23:14:22.238ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
5922026-03-18T23:14:22.271ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
5932026-03-18T23:14:22.329ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ebc07ad0-21df-41e8-bab2-94c12a936308", "content-length": "41", "date": "Wed, 18 Mar 2026 23:14:22 GMT"} }) unit = producer-server
5942026-03-18T23:14:22.330ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
5952026-03-18T23:14:22.432ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5962026-03-18T23:14:22.438ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
5972026-03-18T23:14:22.441ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5982026-03-18T23:14:23.582ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5992026-03-18T23:14:23.588ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6002026-03-18T23:14:23.592ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6012026-03-18T23:14:24.597ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6022026-03-18T23:14:24.603ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6032026-03-18T23:14:24.606ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6042026-03-18T23:14:25.385ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6052026-03-18T23:14:25.390ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6062026-03-18T23:14:25.393ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6072026-03-18T23:14:25.956ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
6082026-03-18T23:14:25.957ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
6092026-03-18T23:14:26.431ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6102026-03-18T23:14:26.437ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6112026-03-18T23:14:26.439ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6122026-03-18T23:14:27.273ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6132026-03-18T23:14:27.279ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6142026-03-18T23:14:27.282ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6152026-03-18T23:14:28.179ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6162026-03-18T23:14:28.185ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6172026-03-18T23:14:28.188ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6182026-03-18T23:14:29.430ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6192026-03-18T23:14:29.435ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6202026-03-18T23:14:29.438ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6212026-03-18T23:14:30.084ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6222026-03-18T23:14:30.091ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6232026-03-18T23:14:30.095ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6242026-03-18T23:14:31.381ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6252026-03-18T23:14:31.383ZINFOtfportd (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::2]:42937 remote_addr = [fd00:1122:3344:101::d]:61913 unit = producer-server
6262026-03-18T23:14:31.387ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6272026-03-18T23:14:31.390ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6282026-03-18T23:14:31.393ZINFOtfportd (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 9253 local_addr = [fd00:1122:3344:101::2]:42937 method = GET remote_addr = [fd00:1122:3344:101::d]:61913 req_id = 493a8fa8-09e8-4d07-89ed-1cf7802aa0d7 response_code = 200 unit = producer-server uri = /8c76a14a-af59-415c-a84d-6b642a24a417
6292026-03-18T23:14:31.948ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6302026-03-18T23:14:31.953ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6312026-03-18T23:14:31.957ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6322026-03-18T23:14:33.128ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6332026-03-18T23:14:33.134ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6342026-03-18T23:14:33.137ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6352026-03-18T23:14:33.662ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6362026-03-18T23:14:33.667ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6372026-03-18T23:14:33.670ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6382026-03-18T23:14:34.470ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6392026-03-18T23:14:34.475ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6402026-03-18T23:14:34.478ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6412026-03-18T23:14:35.482ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6422026-03-18T23:14:35.488ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6432026-03-18T23:14:35.492ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6442026-03-18T23:14:35.959ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
6452026-03-18T23:14:35.960ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
6462026-03-18T23:14:36.673ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6472026-03-18T23:14:36.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6482026-03-18T23:14:36.682ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6492026-03-18T23:14:37.753ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6502026-03-18T23:14:37.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6512026-03-18T23:14:37.762ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6522026-03-18T23:14:38.781ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6532026-03-18T23:14:38.787ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6542026-03-18T23:14:38.790ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6552026-03-18T23:14:39.894ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6562026-03-18T23:14:39.900ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6572026-03-18T23:14:39.903ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6582026-03-18T23:14:40.827ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6592026-03-18T23:14:40.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6602026-03-18T23:14:40.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6612026-03-18T23:14:41.914ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6622026-03-18T23:14:41.920ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6632026-03-18T23:14:41.924ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6642026-03-18T23:14:43.105ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6652026-03-18T23:14:43.110ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6662026-03-18T23:14:43.114ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6672026-03-18T23:14:44.237ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6682026-03-18T23:14:44.242ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6692026-03-18T23:14:44.246ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6702026-03-18T23:14:45.755ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6712026-03-18T23:14:45.761ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6722026-03-18T23:14:45.764ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6732026-03-18T23:14:45.960ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
6742026-03-18T23:14:45.961ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
6752026-03-18T23:14:46.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6762026-03-18T23:14:46.522ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6772026-03-18T23:14:46.525ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6782026-03-18T23:14:47.573ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6792026-03-18T23:14:47.578ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6802026-03-18T23:14:47.581ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6812026-03-18T23:14:48.101ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6822026-03-18T23:14:48.106ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6832026-03-18T23:14:48.110ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6842026-03-18T23:14:49.437ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6852026-03-18T23:14:49.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6862026-03-18T23:14:49.445ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6872026-03-18T23:14:50.766ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6882026-03-18T23:14:50.772ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6892026-03-18T23:14:50.775ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6902026-03-18T23:14:51.930ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6912026-03-18T23:14:51.936ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6922026-03-18T23:14:51.939ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6932026-03-18T23:14:53.297ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6942026-03-18T23:14:53.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6952026-03-18T23:14:53.307ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6962026-03-18T23:14:54.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6972026-03-18T23:14:54.163ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
6982026-03-18T23:14:54.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6992026-03-18T23:14:54.848ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7002026-03-18T23:14:54.854ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
7012026-03-18T23:14:54.857ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
7022026-03-18T23:14:55.962ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11755012570516092394 n_samples = 6 unit = oximeter
7032026-03-18T23:14:55.962ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17914078982432279797 n_samples = 6 unit = oximeter
7042026-03-18T23:14:56.345ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7052026-03-18T23:14:56.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
7062026-03-18T23:14:56.353ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
7072026-03-18T23:14:57.553ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7082026-03-18T23:14:57.559ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
7092026-03-18T23:14:57.562ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
7102026-03-18T23:14:58.699ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7112026-03-18T23:14:58.705ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
7122026-03-18T23:14:58.709ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
7132026-03-18T23:14:59.676ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7142026-03-18T23:14:59.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
7152026-03-18T23:14:59.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
7162026-03-18T23:15:00.475ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7172026-03-18T23:15:00.482ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b415:98ff:feb7:b04c]
7182026-03-18T23:15:00.486ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]