Max level shown:
1 [ Jan 30 03:41:32 Enabled. ]
2 [ Jan 30 03:41:32 Rereading configuration. ]
3 [ Jan 30 03:41:33 Rereading configuration. ]
4 [ Jan 30 03:41:54 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Jan 30 03:41:54 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-01-30T03:41:54.271ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-01-30T03:41:54.317ZINFOtfportd: connected to dpd running softnpu-846348bf
92026-01-30T03:41:54.318ZINFOtfportd: running in sync-only mode
102026-01-30T03:41:54.319ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-01-30T03:41:54.320ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-01-30T03:41:54.321ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 1db1e07f-6540-41dd-8e95-2450ae881aea, ), sled_id: Some( 7c269bf7-eb13-42a1-b02f-6f18599a21a5, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-01-30T03:41:54.321ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-01-30T03:41:54.327ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
162026-01-30T03:41:54.328ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::5c2c:dcff:fe61:95c->5e:2c:dc:61:09:5c interface = tfportrear0_0
172026-01-30T03:41:54.329ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c8e:7dff:fe91:3554->0e:8e:7d:91:35:54 interface = tfportrear0_0
182026-01-30T03:41:54.333ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
192026-01-30T03:41:54.339ZWARNtfportd: tfportqsfp0_0 has no addrs
20 [ Jan 30 03:41:54 Rereading configuration. ]
21 [ Jan 30 03:41:54 Executing refresh method (:kill). ]
22 [ Jan 30 03:41:54 Stopping because all processes in service exited. ]
23 [ Jan 30 03:41:54 Executing stop method (:kill). ]
24 [ Jan 30 03:41:54 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ Jan 30 03:41:54 Method "start" exited with status 0. ]
262026-01-30T03:41:54.829ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272026-01-30T03:41:54.876ZINFOtfportd: connected to dpd running softnpu-846348bf
282026-01-30T03:41:54.876ZINFOtfportd: running in sync-only mode
292026-01-30T03:41:54.876ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302026-01-30T03:41:54.878ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312026-01-30T03:41:54.879ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 1db1e07f-6540-41dd-8e95-2450ae881aea, sled_id: 7c269bf7-eb13-42a1-b02f-6f18599a21a5, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: c1971785-92ea-487d-83b5-eb627dde8301, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322026-01-30T03:41:54.879ZDEBGtfportd: created producer ID producer_id = a0006c0d-1cb9-4b01-bd0f-a02a8accb84e unit = oximeter
332026-01-30T03:41:54.881ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 1db1e07f-6540-41dd-8e95-2450ae881aea, ), sled_id: Some( 7c269bf7-eb13-42a1-b02f-6f18599a21a5, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
342026-01-30T03:41:54.887ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352026-01-30T03:41:54.889ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::5c2c:dcff:fe61:95c->5e:2c:dc:61:09:5c interface = tfportrear0_0
362026-01-30T03:41:54.890ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c8e:7dff:fe91:3554->0e:8e:7d:91:35:54 interface = tfportrear0_0
372026-01-30T03:41:54.891ZDEBGtfportd: registered DTrace probes unit = producer-server
382026-01-30T03:41:54.893ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:50084 method = GET path = /{producer_id} unit = producer-server versions = all
392026-01-30T03:41:54.893ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:50084 unit = producer-server
402026-01-30T03:41:54.893ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:50084 unit = producer-server
412026-01-30T03:41:54.893ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:50084 unit = producer-server
422026-01-30T03:41:54.893ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-01-30T03:41:54.894ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
442026-01-30T03:41:54.894ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
452026-01-30T03:41:54.894ZDEBGtfportd: starting producer registration task unit = producer-server
462026-01-30T03:41:54.895ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-01-30T03:41:54.895ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:50084 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = a0006c0d-1cb9-4b01-bd0f-a02a8accb84e unit = producer-server
482026-01-30T03:41:54.895ZINFOtfportd: created oximeter producer server unit = oximeter
492026-01-30T03:41:54.895ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
502026-01-30T03:41:54.895ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-01-30T03:41:28.097278112Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512026-01-30T03:41:54.895ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 4190389067789899411 unit = oximeter
522026-01-30T03:41:54.895ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532026-01-30T03:41:54.897ZWARNtfportd: tfportqsfp0_0 has no addrs
542026-01-30T03:41:55.559ZINFOtfportd: added new ARP entry entry = 10.151.2.174->1e:e4:71:de:8a:d6 interface = tfportqsfp0_0
552026-01-30T03:41:56.090ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
562026-01-30T03:41:56.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
572026-01-30T03:41:56.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
582026-01-30T03:41:56.099ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
592026-01-30T03:41:56.101ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-01-30T03:41:28.097142658Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
602026-01-30T03:41:56.101ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 7192496358956057109 unit = oximeter
612026-01-30T03:41:56.101ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
622026-01-30T03:41:57.041ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
632026-01-30T03:41:57.046ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
642026-01-30T03:41:57.049ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
652026-01-30T03:41:57.738ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662026-01-30T03:41:57.744ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
672026-01-30T03:41:57.748ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
682026-01-30T03:41:58.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692026-01-30T03:41:58.613ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
702026-01-30T03:41:58.617ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
712026-01-30T03:41:59.898ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 669, tv_nsec: 444622277 } }) unit = producer-server
722026-01-30T03:41:59.899ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
732026-01-30T03:41:59.930ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
742026-01-30T03:42:00.021ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752026-01-30T03:42:00.026ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
762026-01-30T03:42:00.029ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
772026-01-30T03:42:01.043ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-01-30T03:42:01.048ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
792026-01-30T03:42:01.051ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
802026-01-30T03:42:01.824ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812026-01-30T03:42:01.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
822026-01-30T03:42:01.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
832026-01-30T03:42:03.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842026-01-30T03:42:03.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
852026-01-30T03:42:03.022ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
862026-01-30T03:42:03.689ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-01-30T03:42:03.693ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
882026-01-30T03:42:03.695ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
892026-01-30T03:42:04.564ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-01-30T03:42:04.568ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
912026-01-30T03:42:04.571ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
922026-01-30T03:42:04.900ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
932026-01-30T03:42:05.489ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-01-30T03:42:05.493ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
952026-01-30T03:42:05.496ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
962026-01-30T03:42:06.102ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
972026-01-30T03:42:06.785ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982026-01-30T03:42:06.790ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
992026-01-30T03:42:06.793ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1002026-01-30T03:42:07.481ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012026-01-30T03:42:07.486ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1022026-01-30T03:42:07.488ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1032026-01-30T03:42:08.831ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042026-01-30T03:42:08.835ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1052026-01-30T03:42:08.838ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1062026-01-30T03:42:10.048ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072026-01-30T03:42:10.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1082026-01-30T03:42:10.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1092026-01-30T03:42:10.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-01-30T03:42:10.862ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1112026-01-30T03:42:10.864ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1122026-01-30T03:42:12.357ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132026-01-30T03:42:12.361ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1142026-01-30T03:42:12.364ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1152026-01-30T03:42:13.638ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162026-01-30T03:42:13.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1172026-01-30T03:42:13.645ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1182026-01-30T03:42:14.548ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192026-01-30T03:42:14.553ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1202026-01-30T03:42:14.556ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1212026-01-30T03:42:15.111ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
1222026-01-30T03:42:15.139ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1232026-01-30T03:42:15.141ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.037552536s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
1242026-01-30T03:42:15.377ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 684, tv_nsec: 715800244 } }) unit = producer-server
1252026-01-30T03:42:15.377ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1262026-01-30T03:42:15.408ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1272026-01-30T03:42:15.861ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-01-30T03:42:15.865ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1292026-01-30T03:42:15.868ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1302026-01-30T03:42:16.309ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
1312026-01-30T03:42:16.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1322026-01-30T03:42:16.614ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1332026-01-30T03:42:16.616ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1342026-01-30T03:42:17.325ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-01-30T03:42:17.330ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1362026-01-30T03:42:17.333ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1372026-01-30T03:42:18.534ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1382026-01-30T03:42:18.538ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1392026-01-30T03:42:18.541ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1402026-01-30T03:42:19.224ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412026-01-30T03:42:19.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1422026-01-30T03:42:19.231ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1432026-01-30T03:42:20.652ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-01-30T03:42:20.657ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1452026-01-30T03:42:20.659ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1462026-01-30T03:42:21.411ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-01-30T03:42:21.416ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1482026-01-30T03:42:21.419ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1492026-01-30T03:42:22.714ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-01-30T03:42:22.719ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1512026-01-30T03:42:22.722ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1522026-01-30T03:42:23.936ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-01-30T03:42:23.940ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1542026-01-30T03:42:23.942ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1552026-01-30T03:42:25.046ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562026-01-30T03:42:25.051ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1572026-01-30T03:42:25.054ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1582026-01-30T03:42:25.085ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
1592026-01-30T03:42:26.282ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
1602026-01-30T03:42:26.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612026-01-30T03:42:26.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1622026-01-30T03:42:26.396ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1632026-01-30T03:42:27.021ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-01-30T03:42:27.038ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1652026-01-30T03:42:27.042ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1662026-01-30T03:42:28.179ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672026-01-30T03:42:28.185ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1682026-01-30T03:42:28.188ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1692026-01-30T03:42:29.447ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1702026-01-30T03:42:29.452ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1712026-01-30T03:42:29.456ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1722026-01-30T03:42:30.094ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1732026-01-30T03:42:30.105ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1742026-01-30T03:42:30.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1752026-01-30T03:42:30.417ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1762026-01-30T03:42:30.419ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.359208726s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
1772026-01-30T03:42:30.976ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 700, tv_nsec: 359080252 } }) unit = producer-server
1782026-01-30T03:42:31.024ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1792026-01-30T03:42:31.099ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1802026-01-30T03:42:31.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-01-30T03:42:31.261ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1822026-01-30T03:42:31.267ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1832026-01-30T03:42:32.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-01-30T03:42:32.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1852026-01-30T03:42:32.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1862026-01-30T03:42:33.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872026-01-30T03:42:33.558ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1882026-01-30T03:42:33.562ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1892026-01-30T03:42:34.896ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902026-01-30T03:42:34.901ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1912026-01-30T03:42:34.904ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1922026-01-30T03:42:35.066ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
1932026-01-30T03:42:35.483ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-01-30T03:42:35.487ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1952026-01-30T03:42:35.491ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1962026-01-30T03:42:36.257ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
1972026-01-30T03:42:36.635ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1982026-01-30T03:42:36.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
1992026-01-30T03:42:36.649ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2002026-01-30T03:42:37.351ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012026-01-30T03:42:37.356ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2022026-01-30T03:42:37.359ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2032026-01-30T03:42:38.044ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-01-30T03:42:38.049ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2052026-01-30T03:42:38.052ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2062026-01-30T03:42:39.208ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072026-01-30T03:42:39.214ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2082026-01-30T03:42:39.217ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2092026-01-30T03:42:40.336ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102026-01-30T03:42:40.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2112026-01-30T03:42:40.344ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2122026-01-30T03:42:41.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132026-01-30T03:42:41.212ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2142026-01-30T03:42:41.216ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2152026-01-30T03:42:41.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162026-01-30T03:42:41.747ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2172026-01-30T03:42:41.751ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2182026-01-30T03:42:42.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192026-01-30T03:42:43.764ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2202026-01-30T03:42:43.876ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2212026-01-30T03:42:45.174ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
2222026-01-30T03:42:45.229ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-01-30T03:42:45.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2242026-01-30T03:42:45.241ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2252026-01-30T03:42:46.070ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2262026-01-30T03:42:46.526ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 51.504564477s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
2272026-01-30T03:42:46.528ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
2282026-01-30T03:42:46.536ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292026-01-30T03:42:46.564ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2302026-01-30T03:42:46.597ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2312026-01-30T03:42:47.408ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 716, tv_nsec: 828254547 } }) unit = producer-server
2322026-01-30T03:42:47.409ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2332026-01-30T03:42:47.823ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2342026-01-30T03:42:47.833ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352026-01-30T03:42:47.837ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2362026-01-30T03:42:47.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2372026-01-30T03:42:49.213ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382026-01-30T03:42:49.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2392026-01-30T03:42:49.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2402026-01-30T03:42:50.594ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2412026-01-30T03:42:50.600ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2422026-01-30T03:42:50.603ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2432026-01-30T03:42:51.675ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2442026-01-30T03:42:51.681ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2452026-01-30T03:42:51.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2462026-01-30T03:42:52.234ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2472026-01-30T03:42:52.239ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2482026-01-30T03:42:52.242ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2492026-01-30T03:42:53.058ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-01-30T03:42:53.063ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2512026-01-30T03:42:53.065ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2522026-01-30T03:42:54.070ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2532026-01-30T03:42:54.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2542026-01-30T03:42:54.078ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2552026-01-30T03:42:54.762ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562026-01-30T03:42:54.767ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2572026-01-30T03:42:54.771ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2582026-01-30T03:42:55.219ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
2592026-01-30T03:42:55.927ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602026-01-30T03:42:55.932ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2612026-01-30T03:42:55.935ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2622026-01-30T03:42:56.529ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
2632026-01-30T03:42:56.906ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642026-01-30T03:42:56.911ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2652026-01-30T03:42:56.914ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2662026-01-30T03:42:57.575ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672026-01-30T03:42:57.579ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2682026-01-30T03:42:57.582ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2692026-01-30T03:42:58.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702026-01-30T03:42:58.597ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2712026-01-30T03:42:58.600ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2722026-01-30T03:42:59.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2732026-01-30T03:42:59.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2742026-01-30T03:42:59.649ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2752026-01-30T03:43:00.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2762026-01-30T03:43:00.555ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2772026-01-30T03:43:00.559ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2782026-01-30T03:43:01.348ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2792026-01-30T03:43:01.353ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2802026-01-30T03:43:01.356ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2812026-01-30T03:43:02.164ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822026-01-30T03:43:02.169ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2832026-01-30T03:43:02.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2842026-01-30T03:43:02.824ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2852026-01-30T03:43:02.825ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 67.804234997s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
2862026-01-30T03:43:03.433ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2872026-01-30T03:43:03.439ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2882026-01-30T03:43:03.442ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2892026-01-30T03:43:04.501ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2902026-01-30T03:43:04.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2912026-01-30T03:43:04.509ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2922026-01-30T03:43:05.183ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 734, tv_nsec: 604831166 } }) unit = producer-server
2932026-01-30T03:43:05.184ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2942026-01-30T03:43:05.230ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2952026-01-30T03:43:05.232ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
2962026-01-30T03:43:05.239ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972026-01-30T03:43:05.245ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
2982026-01-30T03:43:05.248ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2992026-01-30T03:43:05.919ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002026-01-30T03:43:05.925ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3012026-01-30T03:43:05.929ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3022026-01-30T03:43:06.531ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
3032026-01-30T03:43:06.974ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3042026-01-30T03:43:06.979ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3052026-01-30T03:43:06.983ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3062026-01-30T03:43:08.226ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3072026-01-30T03:43:08.230ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3082026-01-30T03:43:08.233ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3092026-01-30T03:43:08.955ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3102026-01-30T03:43:08.961ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3112026-01-30T03:43:08.964ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3122026-01-30T03:43:09.772ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3132026-01-30T03:43:09.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3142026-01-30T03:43:09.781ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3152026-01-30T03:43:11.178ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3162026-01-30T03:43:11.184ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3172026-01-30T03:43:11.187ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3182026-01-30T03:43:11.994ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3192026-01-30T03:43:12.000ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3202026-01-30T03:43:12.003ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3212026-01-30T03:43:12.621ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222026-01-30T03:43:12.626ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3232026-01-30T03:43:12.628ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3242026-01-30T03:43:13.933ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252026-01-30T03:43:13.939ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3262026-01-30T03:43:13.942ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3272026-01-30T03:43:14.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3282026-01-30T03:43:14.510ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3292026-01-30T03:43:14.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3302026-01-30T03:43:15.058ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3312026-01-30T03:43:15.064ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3322026-01-30T03:43:15.067ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3332026-01-30T03:43:15.234ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
3342026-01-30T03:43:16.307ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3352026-01-30T03:43:16.312ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3362026-01-30T03:43:16.315ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3372026-01-30T03:43:16.532ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
3382026-01-30T03:43:17.073ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3392026-01-30T03:43:17.078ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3402026-01-30T03:43:17.081ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3412026-01-30T03:43:17.617ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3422026-01-30T03:43:17.623ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3432026-01-30T03:43:17.626ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3442026-01-30T03:43:18.847ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452026-01-30T03:43:18.853ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3462026-01-30T03:43:18.856ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3472026-01-30T03:43:20.233ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3482026-01-30T03:43:20.234ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 85.213867287s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
3492026-01-30T03:43:20.277ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3502026-01-30T03:43:20.282ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3512026-01-30T03:43:20.286ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3522026-01-30T03:43:21.571ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3532026-01-30T03:43:21.576ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3542026-01-30T03:43:21.580ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3552026-01-30T03:43:22.962ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3562026-01-30T03:43:22.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3572026-01-30T03:43:22.970ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3582026-01-30T03:43:23.763ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3592026-01-30T03:43:23.767ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3602026-01-30T03:43:23.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3612026-01-30T03:43:23.881ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 753, tv_nsec: 302627947 } }) unit = producer-server
3622026-01-30T03:43:23.882ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3632026-01-30T03:43:23.911ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3642026-01-30T03:43:24.987ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3652026-01-30T03:43:24.992ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3662026-01-30T03:43:24.995ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3672026-01-30T03:43:25.237ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
3682026-01-30T03:43:26.195ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-01-30T03:43:26.201ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3702026-01-30T03:43:26.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3712026-01-30T03:43:26.533ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
3722026-01-30T03:43:27.182ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3732026-01-30T03:43:27.187ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3742026-01-30T03:43:27.190ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3752026-01-30T03:43:28.656ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762026-01-30T03:43:28.661ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3772026-01-30T03:43:28.664ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3782026-01-30T03:43:30.122ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3792026-01-30T03:43:30.127ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3802026-01-30T03:43:30.130ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3812026-01-30T03:43:30.819ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3822026-01-30T03:43:30.825ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3832026-01-30T03:43:30.827ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3842026-01-30T03:43:32.292ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852026-01-30T03:43:32.298ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3862026-01-30T03:43:32.301ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3872026-01-30T03:43:33.460ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882026-01-30T03:43:33.466ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3892026-01-30T03:43:33.468ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3902026-01-30T03:43:34.308ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912026-01-30T03:43:34.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3922026-01-30T03:43:34.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3932026-01-30T03:43:35.171ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3942026-01-30T03:43:35.177ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3952026-01-30T03:43:35.179ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3962026-01-30T03:43:35.240ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
3972026-01-30T03:43:36.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3982026-01-30T03:43:36.471ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
3992026-01-30T03:43:36.474ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4002026-01-30T03:43:36.537ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
4012026-01-30T03:43:37.933ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-01-30T03:43:37.939ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4032026-01-30T03:43:37.942ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4042026-01-30T03:43:38.708ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4052026-01-30T03:43:38.713ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4062026-01-30T03:43:38.716ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4072026-01-30T03:43:38.912ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4082026-01-30T03:43:38.913ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 103.892978758s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
4092026-01-30T03:43:39.962ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4102026-01-30T03:43:39.968ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4112026-01-30T03:43:39.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4122026-01-30T03:43:41.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4132026-01-30T03:43:41.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4142026-01-30T03:43:41.195ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4152026-01-30T03:43:42.237ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4162026-01-30T03:43:42.242ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4172026-01-30T03:43:42.245ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4182026-01-30T03:43:43.049ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4192026-01-30T03:43:43.055ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4202026-01-30T03:43:43.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4212026-01-30T03:43:43.620ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4222026-01-30T03:43:43.626ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4232026-01-30T03:43:43.629ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4242026-01-30T03:43:44.680ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4252026-01-30T03:43:44.686ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4262026-01-30T03:43:44.689ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4272026-01-30T03:43:45.242ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
4282026-01-30T03:43:45.437ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4292026-01-30T03:43:45.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4302026-01-30T03:43:45.445ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4312026-01-30T03:43:46.232ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 775, tv_nsec: 653717563 } }) unit = producer-server
4322026-01-30T03:43:46.236ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4332026-01-30T03:43:46.278ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4342026-01-30T03:43:46.539ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
4352026-01-30T03:43:46.814ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362026-01-30T03:43:46.818ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4372026-01-30T03:43:46.821ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4382026-01-30T03:43:47.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4392026-01-30T03:43:47.511ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4402026-01-30T03:43:47.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4412026-01-30T03:43:48.613ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4422026-01-30T03:43:48.619ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4432026-01-30T03:43:48.652ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4442026-01-30T03:43:49.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4452026-01-30T03:43:49.413ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4462026-01-30T03:43:49.416ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4472026-01-30T03:43:50.123ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4482026-01-30T03:43:50.129ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4492026-01-30T03:43:50.132ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4502026-01-30T03:43:51.212ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4512026-01-30T03:43:51.217ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4522026-01-30T03:43:51.220ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4532026-01-30T03:43:52.394ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4542026-01-30T03:43:52.399ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4552026-01-30T03:43:52.402ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4562026-01-30T03:43:53.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572026-01-30T03:43:53.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4582026-01-30T03:43:53.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4592026-01-30T03:43:54.361ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602026-01-30T03:43:54.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4612026-01-30T03:43:54.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4622026-01-30T03:43:55.246ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
4632026-01-30T03:43:55.699ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4642026-01-30T03:43:55.708ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4652026-01-30T03:43:55.714ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4662026-01-30T03:43:56.359ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672026-01-30T03:43:56.371ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4682026-01-30T03:43:56.377ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4692026-01-30T03:43:56.543ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
4702026-01-30T03:43:57.653ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4712026-01-30T03:43:57.657ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4722026-01-30T03:43:57.666ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4732026-01-30T03:43:58.772ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4742026-01-30T03:43:58.781ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4752026-01-30T03:43:59.051ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4762026-01-30T03:44:04.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4772026-01-30T03:44:04.861ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4782026-01-30T03:44:06.022ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 131.001941914s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
4792026-01-30T03:44:06.846ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4802026-01-30T03:44:07.216ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4812026-01-30T03:44:08.041ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
4822026-01-30T03:44:08.043ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
4832026-01-30T03:44:08.128ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-01-30T03:44:08.142ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4852026-01-30T03:44:08.146ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4862026-01-30T03:44:09.386ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-01-30T03:44:09.392ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4882026-01-30T03:44:09.396ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4892026-01-30T03:44:10.712ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-01-30T03:44:10.718ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4912026-01-30T03:44:10.722ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4922026-01-30T03:44:12.172ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-01-30T03:44:12.177ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4942026-01-30T03:44:12.179ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4952026-01-30T03:44:12.736ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-01-30T03:44:12.741ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
4972026-01-30T03:44:12.744ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4982026-01-30T03:44:14.192ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-01-30T03:44:14.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5002026-01-30T03:44:14.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5012026-01-30T03:44:15.628ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022026-01-30T03:44:15.633ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5032026-01-30T03:44:15.637ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5042026-01-30T03:44:16.355ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5052026-01-30T03:44:16.361ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5062026-01-30T03:44:16.364ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5072026-01-30T03:44:17.269ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5082026-01-30T03:44:17.274ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5092026-01-30T03:44:17.277ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5102026-01-30T03:44:18.258ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
5112026-01-30T03:44:18.259ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
5122026-01-30T03:44:18.409ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-01-30T03:44:18.415ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5142026-01-30T03:44:18.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5152026-01-30T03:44:19.727ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-01-30T03:44:19.733ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5172026-01-30T03:44:19.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5182026-01-30T03:44:21.216ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192026-01-30T03:44:21.221ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5202026-01-30T03:44:21.225ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5212026-01-30T03:44:21.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-01-30T03:44:21.814ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5232026-01-30T03:44:21.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5242026-01-30T03:44:22.987ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-01-30T03:44:22.996ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5262026-01-30T03:44:23.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5272026-01-30T03:44:24.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-01-30T03:44:24.225ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5292026-01-30T03:44:24.229ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5302026-01-30T03:44:25.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312026-01-30T03:44:25.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5322026-01-30T03:44:25.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5332026-01-30T03:44:26.034ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 815, tv_nsec: 454467176 } }) unit = producer-server
5342026-01-30T03:44:26.035ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
5352026-01-30T03:44:26.118ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5362026-01-30T03:44:26.533ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5372026-01-30T03:44:26.602ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5382026-01-30T03:44:26.605ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5392026-01-30T03:44:27.119ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5402026-01-30T03:44:27.125ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5412026-01-30T03:44:27.128ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5422026-01-30T03:44:28.261ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
5432026-01-30T03:44:28.262ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
5442026-01-30T03:44:28.286ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5452026-01-30T03:44:28.291ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5462026-01-30T03:44:28.294ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5472026-01-30T03:44:29.698ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5482026-01-30T03:44:29.707ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5492026-01-30T03:44:29.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5502026-01-30T03:44:31.032ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5512026-01-30T03:44:31.039ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5522026-01-30T03:44:31.043ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5532026-01-30T03:44:32.460ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5542026-01-30T03:44:32.467ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5552026-01-30T03:44:32.471ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5562026-01-30T03:44:33.424ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5572026-01-30T03:44:33.430ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5582026-01-30T03:44:33.474ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5592026-01-30T03:44:34.230ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602026-01-30T03:44:34.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5612026-01-30T03:44:34.239ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5622026-01-30T03:44:35.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5632026-01-30T03:44:35.172ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5642026-01-30T03:44:35.175ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5652026-01-30T03:44:36.384ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5662026-01-30T03:44:36.390ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5672026-01-30T03:44:36.393ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5682026-01-30T03:44:37.040ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5692026-01-30T03:44:37.047ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5702026-01-30T03:44:37.052ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5712026-01-30T03:44:38.310ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
5722026-01-30T03:44:38.311ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
5732026-01-30T03:44:38.456ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5742026-01-30T03:44:38.464ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5752026-01-30T03:44:38.470ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5762026-01-30T03:44:39.679ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5772026-01-30T03:44:39.690ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5782026-01-30T03:44:39.693ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5792026-01-30T03:44:40.611ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5802026-01-30T03:44:40.616ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5812026-01-30T03:44:40.619ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5822026-01-30T03:44:41.119ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
5832026-01-30T03:44:41.120ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 166.100154868s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
5842026-01-30T03:44:41.445ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5852026-01-30T03:44:41.450ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5862026-01-30T03:44:41.453ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5872026-01-30T03:44:42.016ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5882026-01-30T03:44:42.022ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5892026-01-30T03:44:42.026ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5902026-01-30T03:44:43.058ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5912026-01-30T03:44:43.064ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5922026-01-30T03:44:43.067ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5932026-01-30T03:44:43.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5942026-01-30T03:44:43.725ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5952026-01-30T03:44:43.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5962026-01-30T03:44:44.912ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5972026-01-30T03:44:44.918ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
5982026-01-30T03:44:44.920ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5992026-01-30T03:44:45.468ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6002026-01-30T03:44:45.473ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6012026-01-30T03:44:45.476ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6022026-01-30T03:44:46.897ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6032026-01-30T03:44:46.903ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6042026-01-30T03:44:46.909ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6052026-01-30T03:44:48.313ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
6062026-01-30T03:44:48.314ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
6072026-01-30T03:44:48.339ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6082026-01-30T03:44:48.345ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6092026-01-30T03:44:48.348ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6102026-01-30T03:44:49.744ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6112026-01-30T03:44:49.749ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6122026-01-30T03:44:49.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6132026-01-30T03:44:50.946ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6142026-01-30T03:44:50.952ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6152026-01-30T03:44:50.955ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6162026-01-30T03:44:51.500ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6172026-01-30T03:44:51.505ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6182026-01-30T03:44:51.508ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6192026-01-30T03:44:52.287ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6202026-01-30T03:44:52.295ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6212026-01-30T03:44:52.298ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6222026-01-30T03:44:53.583ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6232026-01-30T03:44:53.588ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6242026-01-30T03:44:53.591ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6252026-01-30T03:44:54.825ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6262026-01-30T03:44:54.830ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6272026-01-30T03:44:54.833ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6282026-01-30T03:44:56.281ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6292026-01-30T03:44:56.287ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6302026-01-30T03:44:56.290ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6312026-01-30T03:44:57.330ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6322026-01-30T03:44:57.336ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6332026-01-30T03:44:57.339ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6342026-01-30T03:44:58.024ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6352026-01-30T03:44:58.030ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6362026-01-30T03:44:58.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6372026-01-30T03:44:58.316ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4190389067789899411 n_samples = 6 unit = oximeter
6382026-01-30T03:44:58.316ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7192496358956057109 n_samples = 6 unit = oximeter
6392026-01-30T03:44:58.599ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aaeeb44-3717-4e23-be0e-3d441241317d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c3ac73a-dc55-4965-83f7-f4742139a70e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("683ef436-3a75-4e19-99e3-69691873ddfb.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 848, tv_nsec: 21261171 } }) unit = producer-server
6402026-01-30T03:44:58.600ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
6412026-01-30T03:44:58.633ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
6422026-01-30T03:44:58.755ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6fe7034d-59bf-4c53-ba19-b56fa5dc8306", "content-length": "41", "date": "Fri, 30 Jan 2026 03:44:58 GMT"} }) unit = producer-server
6432026-01-30T03:44:58.757ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
6442026-01-30T03:44:59.288ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6452026-01-30T03:44:59.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6462026-01-30T03:44:59.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6472026-01-30T03:45:00.692ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6482026-01-30T03:45:00.699ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8e:7dff:fe91:3554]
6492026-01-30T03:45:00.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]