Max level shown:
1 [ Jan 27 09:29:31 Disabled. ]
2 [ Jan 27 09:29:31 Rereading configuration. ]
3 [ Jan 27 09:29:32 Enabled. ]
4 [ Jan 27 09:29:32 Rereading configuration. ]
5 [ Jan 27 09:29:32 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_script.sh &"). ]
6 [ Jan 27 09:29:32 Method "start" exited with status 0. ]
72025-01-27T09:29:32.525ZINFOslog-rs: signal handler waiting for context
82025-01-27T09:29:32.549ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
92025-01-27T09:29:32.549ZERROslog-rs: failed to start stats server: underlay address not found
102025-01-27T09:29:32.549ZINFOslog-rs: signal handler waiting got context
112025-01-27T09:29:32.550ZINFOslog-rs: admin: listening on [::1]:8000
122025-01-27T09:29:33.549ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
132025-01-27T09:29:34.549ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
142025-01-27T09:29:35.549ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
152025-01-27T09:29:36.549ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
162025-01-27T09:29:37.549ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
172025-01-27T09:29:38.549ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
182025-01-27T09:29:39.550ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
192025-01-27T09:29:40.550ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
202025-01-27T09:29:41.550ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
212025-01-27T09:29:42.550ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
222025-01-27T09:29:43.550ZINFOslog-rs: [tfportrear0_0] sm initialized with addr fe80::90ed:bff:fe0c:d523 on if tfportrear0_0 index 3
232025-01-27T09:29:43.550ZDEBGslog-rs: [tfportrear0_0] starting discovery handler
242025-01-27T09:29:43.551ZINFOslog-rs: [tfportrear0_0] nbr is fe80::cc45:a8ff:feb3:d814@sock server
252025-01-27T09:29:43.551ZDEBGslog-rs: [tfportrear0_0] transition solicit -> exchange
262025-01-27T09:29:43.551ZINFOslog-rs: [tfportrear0_0] exchange: listening on [fe80::90ed:bff:fe0c:d523]:56797
272025-01-27T09:29:43.551ZINFOslog-rs: [tfportrear0_0] waiting for exchange server to start
28 [ Jan 27 09:29:43 Rereading configuration. ]
29 [ Jan 27 09:29:43 Executing refresh method ("/opt/oxide/mg-ddm/pkg/refresh_ctrun_child.sh -c 215"). ]
30 + CONTRACT=''
31 + getopts c: o
32 + CONTRACT=215
33 + getopts c: o
34 + [[ -n 215 ]]
35 + pgrep -c 215
36 + PARENT_PID=2264
37 + [[ -n 2264 ]]
38 + pgrep -P 2264
39 + CHILD_PID=2268
40 + [[ -n 2268 ]]
41 + kill -USR1 2268
422025-01-27T09:29:43.855ZINFOslog-rs: handling smf refresh
43 [ Jan 27 09:29:43 Method "refresh" exited with status 0. ]
442025-01-27T09:29:43.856ZINFOslog-rs: starting stats server on smf refresh
45 Jan 27 09:29:43.857 DEBG registered DTrace probes
46 Jan 27 09:29:43.857 DEBG registered endpoint, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
47 Jan 27 09:29:43.858 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197
48 Jan 27 09:29:43.858 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
49 Jan 27 09:29:43.858 DEBG Nexus IP not provided, will use DNS to resolve it
50 Jan 27 09:29:43.858 INFO new DNS resolver, addresses: [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53], component: internal-dns-resolver, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/internal-dns/src/resolver.rs:72
51 Jan 27 09:29:43.858 DEBG starting producer registration task
52 Jan 27 09:29:43.858 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:8001, producer_id: 28496ffa-6d9c-4228-ad6f-119c81235ae1, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:283
53 Jan 27 09:29:43.858 DEBG registering / renewing oximeter producer lease with Nexus, component: producer-registration-task
542025-01-27T09:29:44.942ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), boundary_addr: fd30:e3eb:a800:ba26::1, vni: 99, metric: 18446744073709551615, }, }
552025-01-27T09:29:44.943ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), boundary_addr: fd30:e3eb:a800:ba26::1, vni: 99, metric: 18446744073709551615, }, }
562025-01-27T09:29:45.552ZWARNslog-rs: [tfportrear0_0] exchange pull: hyper client error: client error (Connect)
572025-01-27T09:29:45.553ZINFOslog-rs: [tfportrear0_0] sending 5 routes to dendrite
582025-01-27T09:29:45.553ZDEBGslog-rs: [tfportrear0_0] sending to dpd host=localhost port=12224
592025-01-27T09:29:45.596ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:3:: -> fe80::cc45:a8ff:feb3:d814 on port Rear(RearPort(0))/0
602025-01-27T09:29:45.597ZINFOslog-rs: [tfportrear0_0] adding route fdb0:18c0:4d0d:a02a:: -> fe80::cc45:a8ff:feb3:d814 on port Rear(RearPort(0))/0
612025-01-27T09:29:45.597ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:2:: -> fe80::cc45:a8ff:feb3:d814 on port Rear(RearPort(0))/0
622025-01-27T09:29:45.597ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:101:: -> fe80::cc45:a8ff:feb3:d814 on port Rear(RearPort(0))/0
632025-01-27T09:29:45.597ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:1:: -> fe80::cc45:a8ff:feb3:d814 on port Rear(RearPort(0))/0
642025-01-27T09:29:45.598ZINFOslog-rs: [tfportrear0_0] removing routes 0 from dendrite
652025-01-27T09:29:45.630ZDEBGslog-rs: [tfportrear0_0] redistributing update to 0 peers
66 Jan 27 09:29:53.862 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("1283cfe5-16ee-4e4b-b00b-94393a95c90e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("31e6d238-77dc-443c-83f4-2b834aaac06c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("38339a12-b1a8-49b8-a1a9-3eea1fc5d180.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("38339a12-b1a8-49b8-a1a9-3eea1fc5d180.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::c))) }], valid_until: Instant { tv_sec: 110808, tv_nsec: 847773409 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
67 Jan 27 09:29:53.863 DEBG using nexus address for registration, addr: [fd00:1122:3344:101::b]:12221, component: producer-registration-task
68 Jan 27 09:29:53.894 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task