Max level shown:
1 [ Jan 14 00:41:56 Enabled. ]
2 [ Jan 14 00:41:56 Rereading configuration. ]
3 [ Jan 14 00:41:57 Rereading configuration. ]
4 [ Jan 14 00:42:08 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Jan 14 00:42:08 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-01-14T00:42:08.434ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-01-14T00:42:08.475ZINFOtfportd: connected to dpd running softnpu-c9bf538d
92026-01-14T00:42:08.476ZINFOtfportd: running in sync-only mode
102026-01-14T00:42:08.477ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-01-14T00:42:08.478ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-01-14T00:42:08.479ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( a916800d-e6b0-426b-af06-9ffc35170917, ), sled_id: Some( 660a2cdc-6aea-4927-9ec6-6f4272519444, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-01-14T00:42:08.479ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-01-14T00:42:08.484ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::2887:a0ff:fe34:fca7->2a:87:a0:34:fc:a7 interface = tfportrear0_0
162026-01-14T00:42:08.485ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-01-14T00:42:08.490ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
182026-01-14T00:42:08.495ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Jan 14 00:42:09 Rereading configuration. ]
20 [ Jan 14 00:42:09 Executing refresh method (:kill). ]
21 [ Jan 14 00:42:09 Stopping because all processes in service exited. ]
22 [ Jan 14 00:42:09 Executing stop method (:kill). ]
23 [ Jan 14 00:42:09 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Jan 14 00:42:09 Method "start" exited with status 0. ]
252026-01-14T00:42:09.134ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-01-14T00:42:09.177ZINFOtfportd: connected to dpd running softnpu-c9bf538d
272026-01-14T00:42:09.178ZINFOtfportd: running in sync-only mode
282026-01-14T00:42:09.178ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-01-14T00:42:09.180ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-01-14T00:42:09.180ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: a916800d-e6b0-426b-af06-9ffc35170917, sled_id: 660a2cdc-6aea-4927-9ec6-6f4272519444, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 9b7c0080-d7c3-48b6-9333-0b2c067a690d, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-01-14T00:42:09.180ZDEBGtfportd: created producer ID producer_id = 5460ac51-5b99-43fa-a2f3-fb92413cf45e unit = oximeter
322026-01-14T00:42:09.182ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( a916800d-e6b0-426b-af06-9ffc35170917, ), sled_id: Some( 660a2cdc-6aea-4927-9ec6-6f4272519444, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-01-14T00:42:09.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-01-14T00:42:09.190ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::7082:aeff:fef8:38ec->72:82:ae:f8:38:ec interface = tfportrear0_0
352026-01-14T00:42:09.190ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::2887:a0ff:fe34:fca7->2a:87:a0:34:fc:a7 interface = tfportrear0_0
362026-01-14T00:42:09.192ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-01-14T00:42:09.193ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:64618 method = GET path = /{producer_id} unit = producer-server versions = all
382026-01-14T00:42:09.193ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:64618 unit = producer-server
392026-01-14T00:42:09.193ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:64618 unit = producer-server
402026-01-14T00:42:09.193ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:64618 unit = producer-server
412026-01-14T00:42:09.193ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-01-14T00:42:09.193ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-01-14T00:42:09.194ZDEBGtfportd: starting producer registration task unit = producer-server
442026-01-14T00:42:09.194ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:64618 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 5460ac51-5b99-43fa-a2f3-fb92413cf45e unit = producer-server
452026-01-14T00:42:09.194ZINFOtfportd: created oximeter producer server unit = oximeter
462026-01-14T00:42:09.194ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-01-14T00:42:09.194ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
482026-01-14T00:42:09.195ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-01-14T00:42:09.196ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-01-14T00:41:52.441637682Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-01-14T00:42:09.196ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 2792567763287652230 unit = oximeter
512026-01-14T00:42:09.196ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-01-14T00:42:09.197ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-01-14T00:42:09.765ZINFOtfportd: added new ARP entry entry = 10.151.1.174->d2:28:33:e7:00:49 interface = tfportqsfp0_0
542026-01-14T00:42:10.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552026-01-14T00:42:10.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
562026-01-14T00:42:10.022ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572026-01-14T00:42:10.022ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582026-01-14T00:42:10.023ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-01-14T00:41:52.441505299Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592026-01-14T00:42:10.023ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 10522550740184997625 unit = oximeter
602026-01-14T00:42:10.024ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612026-01-14T00:42:10.553ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-01-14T00:42:10.557ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
632026-01-14T00:42:10.560ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642026-01-14T00:42:11.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-01-14T00:42:11.455ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
662026-01-14T00:42:11.459ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-01-14T00:42:12.544ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-01-14T00:42:12.549ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
692026-01-14T00:42:12.552ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-01-14T00:42:13.501ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-01-14T00:42:13.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
722026-01-14T00:42:13.510ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
732026-01-14T00:42:14.196ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1eb594a6-c5d9-4952-985b-4c7e3ff021c5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("89b5a5ae-17a9-4db4-8e7e-741958b4f86c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 645, tv_nsec: 972790061 } }) unit = producer-server
742026-01-14T00:42:14.197ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
752026-01-14T00:42:14.229ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
762026-01-14T00:42:14.768ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-01-14T00:42:14.772ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
782026-01-14T00:42:14.774ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-01-14T00:42:16.138ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-01-14T00:42:16.142ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
812026-01-14T00:42:16.145ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-01-14T00:42:17.546ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-01-14T00:42:17.551ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
842026-01-14T00:42:17.554ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-01-14T00:42:19.053ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-01-14T00:42:19.058ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
872026-01-14T00:42:19.060ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882026-01-14T00:42:19.200ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
892026-01-14T00:42:19.613ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-01-14T00:42:19.618ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
912026-01-14T00:42:19.620ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
922026-01-14T00:42:20.026ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
932026-01-14T00:42:20.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-01-14T00:42:20.308ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
952026-01-14T00:42:20.311ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-01-14T00:42:21.219ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-01-14T00:42:21.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
982026-01-14T00:42:21.226ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-01-14T00:42:22.401ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-01-14T00:42:22.406ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1012026-01-14T00:42:22.409ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-01-14T00:42:23.618ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-01-14T00:42:23.623ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1042026-01-14T00:42:23.626ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052026-01-14T00:42:25.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-01-14T00:42:25.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1072026-01-14T00:42:25.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-01-14T00:42:25.562ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-01-14T00:42:25.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1102026-01-14T00:42:25.574ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112026-01-14T00:42:26.869ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-01-14T00:42:26.875ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1132026-01-14T00:42:26.879ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142026-01-14T00:42:27.556ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-01-14T00:42:27.562ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1162026-01-14T00:42:27.566ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172026-01-14T00:42:29.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-01-14T00:42:29.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1192026-01-14T00:42:29.039ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1202026-01-14T00:42:29.580ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
1212026-01-14T00:42:29.608ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1222026-01-14T00:42:29.609ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.037475216s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
1232026-01-14T00:42:29.963ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1eb594a6-c5d9-4952-985b-4c7e3ff021c5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("89b5a5ae-17a9-4db4-8e7e-741958b4f86c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 661, tv_nsec: 362668779 } }) unit = producer-server
1242026-01-14T00:42:29.970ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1252026-01-14T00:42:29.991ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1262026-01-14T00:42:30.023ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1272026-01-14T00:42:30.030ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1282026-01-14T00:42:30.135ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1292026-01-14T00:42:30.404ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
1302026-01-14T00:42:30.829ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-01-14T00:42:30.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1322026-01-14T00:42:30.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-01-14T00:42:31.833ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-01-14T00:42:31.840ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1352026-01-14T00:42:31.844ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362026-01-14T00:42:33.175ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-01-14T00:42:33.179ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1382026-01-14T00:42:33.182ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392026-01-14T00:42:34.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-01-14T00:42:34.226ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1412026-01-14T00:42:34.229ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-01-14T00:42:35.575ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-01-14T00:42:35.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1442026-01-14T00:42:35.585ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-01-14T00:42:36.613ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-01-14T00:42:36.625ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1472026-01-14T00:42:36.628ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482026-01-14T00:42:38.117ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-01-14T00:42:38.129ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1502026-01-14T00:42:38.140ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512026-01-14T00:42:38.949ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-01-14T00:42:38.956ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1532026-01-14T00:42:38.961ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542026-01-14T00:42:39.541ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552026-01-14T00:42:39.549ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1562026-01-14T00:42:39.553ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1572026-01-14T00:42:39.558ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
1582026-01-14T00:42:40.380ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
1592026-01-14T00:42:40.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602026-01-14T00:42:40.571ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1612026-01-14T00:42:40.575ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622026-01-14T00:42:41.087ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632026-01-14T00:42:41.091ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1642026-01-14T00:42:41.094ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652026-01-14T00:42:42.001ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662026-01-14T00:42:42.007ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1672026-01-14T00:42:42.009ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1682026-01-14T00:42:43.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-01-14T00:42:43.005ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1702026-01-14T00:42:43.008ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1712026-01-14T00:42:43.793ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722026-01-14T00:42:43.800ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1732026-01-14T00:42:43.803ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1742026-01-14T00:42:44.929ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752026-01-14T00:42:44.934ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1762026-01-14T00:42:44.937ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1772026-01-14T00:42:45.096ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1782026-01-14T00:42:45.097ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.567632512s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
1792026-01-14T00:42:45.352ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1eb594a6-c5d9-4952-985b-4c7e3ff021c5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("89b5a5ae-17a9-4db4-8e7e-741958b4f86c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 676, tv_nsec: 792966081 } }) unit = producer-server
1802026-01-14T00:42:45.352ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1812026-01-14T00:42:45.383ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1822026-01-14T00:42:45.955ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-01-14T00:42:45.960ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1842026-01-14T00:42:45.963ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852026-01-14T00:42:47.127ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-01-14T00:42:47.131ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1872026-01-14T00:42:47.134ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1882026-01-14T00:42:47.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892026-01-14T00:42:47.792ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1902026-01-14T00:42:47.794ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1912026-01-14T00:42:48.388ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922026-01-14T00:42:48.394ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1932026-01-14T00:42:48.397ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1942026-01-14T00:42:49.134ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952026-01-14T00:42:49.139ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
1962026-01-14T00:42:49.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1972026-01-14T00:42:49.533ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
1982026-01-14T00:42:50.210ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1992026-01-14T00:42:50.215ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2002026-01-14T00:42:50.219ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2012026-01-14T00:42:50.354ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
2022026-01-14T00:42:51.030ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-01-14T00:42:51.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2042026-01-14T00:42:51.038ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-01-14T00:42:52.537ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-01-14T00:42:52.550ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2072026-01-14T00:42:52.566ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082026-01-14T00:42:53.912ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-01-14T00:42:53.917ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2102026-01-14T00:42:53.920ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112026-01-14T00:42:54.959ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-01-14T00:42:54.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2132026-01-14T00:42:54.969ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142026-01-14T00:42:56.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-01-14T00:42:56.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2162026-01-14T00:42:56.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172026-01-14T00:42:56.716ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182026-01-14T00:42:56.721ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2192026-01-14T00:42:56.724ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2202026-01-14T00:42:57.281ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2212026-01-14T00:42:57.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2222026-01-14T00:42:57.288ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2232026-01-14T00:42:57.888ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2242026-01-14T00:42:57.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2252026-01-14T00:42:57.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2262026-01-14T00:42:59.203ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2272026-01-14T00:42:59.208ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2282026-01-14T00:42:59.211ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2292026-01-14T00:42:59.508ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
2302026-01-14T00:43:00.328ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
2312026-01-14T00:43:00.344ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2322026-01-14T00:43:00.344ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.855876715s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
2332026-01-14T00:43:00.511ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-01-14T00:43:00.516ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2352026-01-14T00:43:00.519ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362026-01-14T00:43:01.513ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1eb594a6-c5d9-4952-985b-4c7e3ff021c5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("89b5a5ae-17a9-4db4-8e7e-741958b4f86c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 692, tv_nsec: 997485164 } }) unit = producer-server
2372026-01-14T00:43:01.513ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2382026-01-14T00:43:01.544ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2392026-01-14T00:43:01.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-01-14T00:43:01.728ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2412026-01-14T00:43:01.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-01-14T00:43:02.793ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-01-14T00:43:02.797ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2442026-01-14T00:43:02.800ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-01-14T00:43:04.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-01-14T00:43:04.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2472026-01-14T00:43:04.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-01-14T00:43:04.747ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-01-14T00:43:04.753ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2502026-01-14T00:43:04.755ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512026-01-14T00:43:05.734ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-01-14T00:43:05.740ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2532026-01-14T00:43:05.744ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542026-01-14T00:43:06.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-01-14T00:43:06.914ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2562026-01-14T00:43:06.917ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572026-01-14T00:43:08.145ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-01-14T00:43:08.151ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2592026-01-14T00:43:08.154ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2602026-01-14T00:43:08.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612026-01-14T00:43:08.791ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2622026-01-14T00:43:08.794ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2632026-01-14T00:43:09.483ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
2642026-01-14T00:43:10.078ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2652026-01-14T00:43:10.085ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2662026-01-14T00:43:10.090ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2672026-01-14T00:43:10.301ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
2682026-01-14T00:43:10.642ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2692026-01-14T00:43:10.647ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2702026-01-14T00:43:10.650ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2712026-01-14T00:43:11.445ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-01-14T00:43:11.450ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2732026-01-14T00:43:11.452ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2742026-01-14T00:43:12.253ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752026-01-14T00:43:12.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2762026-01-14T00:43:12.260ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2772026-01-14T00:43:12.931ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2782026-01-14T00:43:12.936ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2792026-01-14T00:43:12.939ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2802026-01-14T00:43:14.144ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2812026-01-14T00:43:14.150ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2822026-01-14T00:43:14.153ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2832026-01-14T00:43:15.492ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2842026-01-14T00:43:15.498ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2852026-01-14T00:43:15.501ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2862026-01-14T00:43:16.505ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2872026-01-14T00:43:16.505ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 67.06084394s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
2882026-01-14T00:43:16.879ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-01-14T00:43:16.884ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2902026-01-14T00:43:16.888ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2912026-01-14T00:43:18.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2922026-01-14T00:43:18.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2932026-01-14T00:43:18.353ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2942026-01-14T00:43:18.662ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1eb594a6-c5d9-4952-985b-4c7e3ff021c5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("89b5a5ae-17a9-4db4-8e7e-741958b4f86c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 710, tv_nsec: 193018852 } }) unit = producer-server
2952026-01-14T00:43:18.662ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2962026-01-14T00:43:18.694ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2972026-01-14T00:43:19.107ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-01-14T00:43:19.112ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
2992026-01-14T00:43:19.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3002026-01-14T00:43:19.459ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
3012026-01-14T00:43:19.649ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3022026-01-14T00:43:19.656ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3032026-01-14T00:43:19.659ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3042026-01-14T00:43:20.276ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
3052026-01-14T00:43:20.547ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-01-14T00:43:20.554ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3072026-01-14T00:43:20.557ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082026-01-14T00:43:21.312ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-01-14T00:43:21.317ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3102026-01-14T00:43:21.320ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3112026-01-14T00:43:22.072ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-01-14T00:43:22.081ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3132026-01-14T00:43:22.084ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3142026-01-14T00:43:23.585ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-01-14T00:43:23.591ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3162026-01-14T00:43:23.594ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172026-01-14T00:43:24.709ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-01-14T00:43:24.714ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3192026-01-14T00:43:24.717ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202026-01-14T00:43:26.154ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-01-14T00:43:26.159ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3222026-01-14T00:43:26.162ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3232026-01-14T00:43:26.856ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242026-01-14T00:43:26.861ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3252026-01-14T00:43:26.864ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3262026-01-14T00:43:27.870ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272026-01-14T00:43:27.876ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3282026-01-14T00:43:27.879ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3292026-01-14T00:43:29.251ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3302026-01-14T00:43:29.256ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3312026-01-14T00:43:29.259ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3322026-01-14T00:43:29.433ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
3332026-01-14T00:43:30.041ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342026-01-14T00:43:30.047ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3352026-01-14T00:43:30.050ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3362026-01-14T00:43:30.251ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
3372026-01-14T00:43:31.302ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3382026-01-14T00:43:31.307ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3392026-01-14T00:43:31.310ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3402026-01-14T00:43:32.264ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3412026-01-14T00:43:32.270ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3422026-01-14T00:43:32.273ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3432026-01-14T00:43:33.022ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3442026-01-14T00:43:33.028ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3452026-01-14T00:43:33.031ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3462026-01-14T00:43:33.654ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3472026-01-14T00:43:33.655ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 84.256905609s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
3482026-01-14T00:43:33.715ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-01-14T00:43:33.720ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3502026-01-14T00:43:33.723ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-01-14T00:43:34.924ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-01-14T00:43:34.930ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3532026-01-14T00:43:34.933ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3542026-01-14T00:43:35.766ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-01-14T00:43:35.772ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3562026-01-14T00:43:35.776ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3572026-01-14T00:43:36.491ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582026-01-14T00:43:36.496ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3592026-01-14T00:43:36.499ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3602026-01-14T00:43:37.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612026-01-14T00:43:37.863ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3622026-01-14T00:43:37.866ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3632026-01-14T00:43:38.141ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1eb594a6-c5d9-4952-985b-4c7e3ff021c5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("89b5a5ae-17a9-4db4-8e7e-741958b4f86c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 729, tv_nsec: 725530882 } }) unit = producer-server
3642026-01-14T00:43:38.142ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3652026-01-14T00:43:38.171ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3662026-01-14T00:43:39.322ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-01-14T00:43:39.328ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3682026-01-14T00:43:39.331ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3692026-01-14T00:43:39.407ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
3702026-01-14T00:43:40.226ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
3712026-01-14T00:43:40.289ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722026-01-14T00:43:40.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3732026-01-14T00:43:40.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3742026-01-14T00:43:41.222ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-01-14T00:43:41.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3762026-01-14T00:43:41.231ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3772026-01-14T00:43:42.154ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-01-14T00:43:42.159ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3792026-01-14T00:43:42.162ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3802026-01-14T00:43:43.114ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-01-14T00:43:43.118ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3822026-01-14T00:43:43.121ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3832026-01-14T00:43:44.435ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-01-14T00:43:44.441ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3852026-01-14T00:43:44.444ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3862026-01-14T00:43:45.336ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-01-14T00:43:45.342ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3882026-01-14T00:43:45.345ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3892026-01-14T00:43:46.036ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3902026-01-14T00:43:46.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3912026-01-14T00:43:46.044ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3922026-01-14T00:43:47.390ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3932026-01-14T00:43:47.395ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3942026-01-14T00:43:47.398ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3952026-01-14T00:43:48.203ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962026-01-14T00:43:48.209ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
3972026-01-14T00:43:48.212ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982026-01-14T00:43:49.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-01-14T00:43:49.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4002026-01-14T00:43:49.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012026-01-14T00:43:49.382ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
4022026-01-14T00:43:49.731ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4032026-01-14T00:43:49.736ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4042026-01-14T00:43:49.739ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4052026-01-14T00:43:50.201ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
4062026-01-14T00:43:50.883ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4072026-01-14T00:43:50.889ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4082026-01-14T00:43:50.892ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4092026-01-14T00:43:51.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4102026-01-14T00:43:51.664ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4112026-01-14T00:43:51.667ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4122026-01-14T00:43:52.839ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4132026-01-14T00:43:52.845ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4142026-01-14T00:43:52.849ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4152026-01-14T00:43:53.132ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4162026-01-14T00:43:53.133ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 103.787157941s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
4172026-01-14T00:43:53.476ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-01-14T00:43:53.482ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4192026-01-14T00:43:53.485ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4202026-01-14T00:43:54.330ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-01-14T00:43:54.336ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4222026-01-14T00:43:54.339ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4232026-01-14T00:43:55.626ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-01-14T00:43:55.631ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4252026-01-14T00:43:55.634ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262026-01-14T00:43:56.950ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-01-14T00:43:56.956ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4282026-01-14T00:43:56.959ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292026-01-14T00:43:58.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-01-14T00:43:58.181ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4312026-01-14T00:43:58.184ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4322026-01-14T00:43:59.101ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-01-14T00:43:59.107ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4342026-01-14T00:43:59.110ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4352026-01-14T00:43:59.357ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
4362026-01-14T00:44:00.176ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
4372026-01-14T00:44:00.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4382026-01-14T00:44:00.345ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4392026-01-14T00:44:00.348ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4402026-01-14T00:44:00.863ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4412026-01-14T00:44:00.868ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4422026-01-14T00:44:00.872ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4432026-01-14T00:44:01.611ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-01-14T00:44:01.617ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4452026-01-14T00:44:01.619ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4462026-01-14T00:44:02.612ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-01-14T00:44:02.616ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4482026-01-14T00:44:02.620ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-01-14T00:44:03.752ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-01-14T00:44:03.757ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4512026-01-14T00:44:03.760ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522026-01-14T00:44:04.139ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1eb594a6-c5d9-4952-985b-4c7e3ff021c5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("89b5a5ae-17a9-4db4-8e7e-741958b4f86c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 755, tv_nsec: 793290894 } }) unit = producer-server
4532026-01-14T00:44:04.139ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4542026-01-14T00:44:04.170ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4552026-01-14T00:44:04.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-01-14T00:44:04.898ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4572026-01-14T00:44:04.901ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582026-01-14T00:44:06.280ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-01-14T00:44:06.286ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4602026-01-14T00:44:06.290ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612026-01-14T00:44:06.838ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-01-14T00:44:06.844ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4632026-01-14T00:44:06.847ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642026-01-14T00:44:07.899ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-01-14T00:44:07.905ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4662026-01-14T00:44:07.908ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672026-01-14T00:44:08.521ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4682026-01-14T00:44:08.527ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4692026-01-14T00:44:08.530ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4702026-01-14T00:44:09.332ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
4712026-01-14T00:44:09.778ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722026-01-14T00:44:09.784ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4732026-01-14T00:44:09.787ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4742026-01-14T00:44:10.151ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
4752026-01-14T00:44:11.201ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762026-01-14T00:44:11.207ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4772026-01-14T00:44:11.210ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4782026-01-14T00:44:11.722ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792026-01-14T00:44:11.728ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4802026-01-14T00:44:11.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4812026-01-14T00:44:12.343ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822026-01-14T00:44:12.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4832026-01-14T00:44:12.351ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842026-01-14T00:44:13.067ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852026-01-14T00:44:13.072ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4862026-01-14T00:44:13.075ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872026-01-14T00:44:14.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882026-01-14T00:44:14.502ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4892026-01-14T00:44:14.505ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4902026-01-14T00:44:15.486ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912026-01-14T00:44:15.491ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4922026-01-14T00:44:15.495ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4932026-01-14T00:44:16.927ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942026-01-14T00:44:16.933ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4952026-01-14T00:44:16.936ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4962026-01-14T00:44:18.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972026-01-14T00:44:18.213ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
4982026-01-14T00:44:18.217ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4992026-01-14T00:44:19.130ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
5002026-01-14T00:44:19.132ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 129.856554907s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
5012026-01-14T00:44:19.301ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022026-01-14T00:44:19.306ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
5032026-01-14T00:44:19.306ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5042026-01-14T00:44:19.309ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5052026-01-14T00:44:20.126ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
5062026-01-14T00:44:20.411ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-01-14T00:44:20.417ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5082026-01-14T00:44:20.420ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5092026-01-14T00:44:21.633ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-01-14T00:44:21.639ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5112026-01-14T00:44:21.642ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5122026-01-14T00:44:22.270ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-01-14T00:44:22.276ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5142026-01-14T00:44:22.279ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5152026-01-14T00:44:23.215ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-01-14T00:44:23.219ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5172026-01-14T00:44:23.222ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5182026-01-14T00:44:24.102ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192026-01-14T00:44:24.107ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5202026-01-14T00:44:24.111ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5212026-01-14T00:44:25.224ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-01-14T00:44:25.229ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5232026-01-14T00:44:25.232ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242026-01-14T00:44:25.935ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-01-14T00:44:25.940ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5262026-01-14T00:44:25.943ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5272026-01-14T00:44:27.422ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-01-14T00:44:27.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5292026-01-14T00:44:27.430ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5302026-01-14T00:44:28.559ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312026-01-14T00:44:28.564ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5322026-01-14T00:44:28.567ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5332026-01-14T00:44:29.280ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
5342026-01-14T00:44:29.365ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5352026-01-14T00:44:29.369ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5362026-01-14T00:44:29.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5372026-01-14T00:44:30.101ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
5382026-01-14T00:44:30.292ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-01-14T00:44:30.297ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5402026-01-14T00:44:30.300ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5412026-01-14T00:44:31.382ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-01-14T00:44:31.388ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5432026-01-14T00:44:31.391ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5442026-01-14T00:44:32.619ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5452026-01-14T00:44:32.625ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5462026-01-14T00:44:32.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5472026-01-14T00:44:33.968ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5482026-01-14T00:44:33.973ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5492026-01-14T00:44:33.975ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5502026-01-14T00:44:34.958ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5512026-01-14T00:44:34.964ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5522026-01-14T00:44:34.967ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5532026-01-14T00:44:35.867ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5542026-01-14T00:44:35.872ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5552026-01-14T00:44:35.875ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5562026-01-14T00:44:36.487ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5572026-01-14T00:44:36.492ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5582026-01-14T00:44:36.495ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5592026-01-14T00:44:37.839ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602026-01-14T00:44:37.843ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5612026-01-14T00:44:37.847ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5622026-01-14T00:44:39.206ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5632026-01-14T00:44:39.211ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5642026-01-14T00:44:39.214ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5652026-01-14T00:44:39.255ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
5662026-01-14T00:44:39.841ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5672026-01-14T00:44:39.846ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5682026-01-14T00:44:39.849ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5692026-01-14T00:44:40.076ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
5702026-01-14T00:44:40.281ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1eb594a6-c5d9-4952-985b-4c7e3ff021c5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("89b5a5ae-17a9-4db4-8e7e-741958b4f86c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c1f23fcd-ab57-450d-b7a8-716fca1ee8a4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 792, tv_nsec: 33569125 } }) unit = producer-server
5712026-01-14T00:44:40.282ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
5722026-01-14T00:44:40.313ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
5732026-01-14T00:44:40.376ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5742026-01-14T00:44:40.381ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5752026-01-14T00:44:40.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5762026-01-14T00:44:41.868ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5772026-01-14T00:44:41.873ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5782026-01-14T00:44:41.876ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5792026-01-14T00:44:42.570ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5802026-01-14T00:44:42.575ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5812026-01-14T00:44:42.577ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5822026-01-14T00:44:43.208ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5832026-01-14T00:44:43.213ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5842026-01-14T00:44:43.216ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5852026-01-14T00:44:44.613ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5862026-01-14T00:44:44.617ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5872026-01-14T00:44:44.620ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5882026-01-14T00:44:45.988ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5892026-01-14T00:44:45.994ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5902026-01-14T00:44:45.997ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5912026-01-14T00:44:47.361ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5922026-01-14T00:44:47.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5932026-01-14T00:44:47.369ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5942026-01-14T00:44:48.589ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5952026-01-14T00:44:48.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
5962026-01-14T00:44:48.596ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5972026-01-14T00:44:49.231ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
5982026-01-14T00:44:49.910ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5992026-01-14T00:44:49.914ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6002026-01-14T00:44:49.917ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6012026-01-14T00:44:50.051ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter
6022026-01-14T00:44:51.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6032026-01-14T00:44:51.034ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6042026-01-14T00:44:51.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6052026-01-14T00:44:51.559ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6062026-01-14T00:44:51.565ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6072026-01-14T00:44:51.568ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6082026-01-14T00:44:52.973ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6092026-01-14T00:44:52.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6102026-01-14T00:44:52.981ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6112026-01-14T00:44:54.237ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6122026-01-14T00:44:54.241ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6132026-01-14T00:44:54.244ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6142026-01-14T00:44:54.979ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6152026-01-14T00:44:54.983ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6162026-01-14T00:44:54.986ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6172026-01-14T00:44:55.274ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
6182026-01-14T00:44:55.275ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 166.0977466s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
6192026-01-14T00:44:56.219ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6202026-01-14T00:44:56.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6212026-01-14T00:44:56.227ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6222026-01-14T00:44:57.113ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6232026-01-14T00:44:57.118ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6242026-01-14T00:44:57.122ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6252026-01-14T00:44:58.135ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6262026-01-14T00:44:58.140ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6272026-01-14T00:44:58.143ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6282026-01-14T00:44:58.803ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6292026-01-14T00:44:58.808ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6302026-01-14T00:44:58.811ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6312026-01-14T00:44:59.205ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2792567763287652230 n_samples = 6 unit = oximeter
6322026-01-14T00:44:59.731ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6332026-01-14T00:44:59.736ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::2887:a0ff:fe34:fca7]
6342026-01-14T00:44:59.739ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6352026-01-14T00:45:00.025ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10522550740184997625 n_samples = 6 unit = oximeter