Max level shown:
1 [ Jun 12 21:22:19 Disabled. ]
2 [ Jun 12 21:22:19 Rereading configuration. ]
3 [ Jun 12 21:22:32 Rereading configuration. ]
4 [ Jun 12 21:22:32 Rereading configuration. ]
5 [ Jun 12 21:22:32 Enabled. ]
6 [ Jun 12 21:22:32 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mgd/pkg/mgd_method_script.sh &"). ]
7 [ Jun 12 21:22:32 Method "start" exited with status 0. ]
82024-06-12T21:22:32.391ZINFOslog-rs: signal handler waiting for context
92024-06-12T21:22:32.408ZINFOslog-rs: signal handler waiting got context
102024-06-12T21:22:32.408ZINFOslog-rs: bgp routers: {}
112024-06-12T21:22:32.408ZINFOslog-rs: bfd peers: []
122024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bfd/peers unit = api-server
132024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bfd/peers unit = api-server
142024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bfd/peers/{addr} unit = api-server
152024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/checker unit = api-server
162024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/checker unit = api-server
172024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/checker unit = api-server
182024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/checker unit = api-server
192024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/neighbor unit = api-server
202024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/neighbor unit = api-server
212024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/neighbor unit = api-server
222024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/neighbor unit = api-server
232024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/neighbors unit = api-server
242024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/origin4 unit = api-server
252024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/origin4 unit = api-server
262024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/origin4 unit = api-server
272024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/origin4 unit = api-server
282024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/router unit = api-server
292024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/router unit = api-server
302024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/router unit = api-server
312024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/router unit = api-server
322024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/routers unit = api-server
332024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/shaper unit = api-server
342024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/shaper unit = api-server
352024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/shaper unit = api-server
362024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/shaper unit = api-server
372024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/message-history unit = api-server
382024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/omicron/apply unit = api-server
392024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/imported unit = api-server
402024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/neighbors unit = api-server
412024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/selected unit = api-server
422024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /static/route4 unit = api-server
432024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /static/route4 unit = api-server
442024-06-12T21:22:32.412ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /static/route4 unit = api-server
452024-06-12T21:22:32.412ZINFOslog-rs: admin: listening on [::]:4676
462024-06-12T21:22:32.412ZINFOslog-rs: listening local_addr = [::]:4676 unit = api-server
472024-06-12T21:22:32.413ZDEBGslog-rs: successfully registered DTrace USDT probes local_addr = [::]:4676 unit = api-server
482024-06-12T21:22:32.483ZERROslog-rs: get originated tunnel endpoints: Communication Error: error sending request for url (http://localhost:8000/originated_tunnel_endpoints): error trying to connect: tcp connect error: Connection refused (os error 146)
49 [ Jun 12 21:22:33 Rereading configuration. ]
50 [ Jun 12 21:22:33 Executing refresh method ("/opt/oxide/mgd/pkg/refresh_ctrun_child.sh -c 434"). ]
51 + CONTRACT=''
52 + getopts c: o
53 + CONTRACT=434
54 + getopts c: o
55 + [[ -n 434 ]]
56 + pgrep -c 434
57 + PARENT_PID=4201
58 + [[ -n 4201 ]]
59 + pgrep -P 4201
60 + CHILD_PID=4202
61 + [[ -n 4202 ]]
62 + kill -USR1 4202
632024-06-12T21:22:33.843ZINFOslog-rs: handling smf refresh
642024-06-12T21:22:33.844ZINFOslog-rs: starting stats server on smf refresh
65 [ Jun 12 21:22:33 Method "refresh" exited with status 0. ]
662024-06-12T21:22:33.845ZINFOslog-rs: resolving nexus
672024-06-12T21:22:33.845ZINFOslog-rs: new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53]
682024-06-12T21:22:34.038ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::1]:41290 unit = api-server
692024-06-12T21:22:34.038ZINFOslog-rs: request completed latency_us = 381 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::1]:41290 req_id = 7127f3aa-01f5-4637-842f-f6938790ebd2 response_code = 204 unit = api-server uri = /static/route4
702024-06-12T21:22:34.039ZERROslog-rs: handling change failed: libnet error route io error No such process (os error 3)
712024-06-12T21:22:34.039ZINFOslog-rs: restarting sync loop
722024-06-12T21:22:38.846ZWARNslog-rs: resolving nexus failed, no record found for Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } waiting 123.697505ms
732024-06-12T21:22:38.972ZDEBGslog-rs: lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 741, tv_nsec: 657636600 } })
74 Jun 12 21:22:38.974 DEBG registered DTrace probes
75 Jun 12 21:22:38.974 DEBG registered endpoint, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
76 Jun 12 21:22:38.974 INFO listening, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0560bed/dropshot/src/server.rs:196
77 Jun 12 21:22:38.974 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
78 Jun 12 21:22:38.975 DEBG Nexus IP provided explicitly, will use it, addr: [fd00:1122:3344:101::a]:12221
79 Jun 12 21:22:38.975 DEBG starting producer registration task
80 Jun 12 21:22:38.975 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:4677, producer_id: 5d108285-c533-41ea-b0cc-e5d0c70b1583, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:276
81 Jun 12 21:22:38.975 DEBG registering / renewing oximeter producer lease with Nexus, component: producer-registration-task
82 Jun 12 21:22:38.975 DEBG using nexus address for registration, addr: [fd00:1122:3344:101::a]:12221, component: producer-registration-task
83 Jun 12 21:22:39.006 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
84 Jun 12 21:22:54.779 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
85 Jun 12 21:22:54.780 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 280.580647ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
86 Jun 12 21:22:55.096 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
87 Jun 12 21:23:10.097 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
88 Jun 12 21:23:10.098 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 616.997325ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
89 Jun 12 21:23:10.747 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
90 Jun 12 21:23:25.748 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
91 Jun 12 21:23:25.749 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 594.346442ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
92 Jun 12 21:23:26.379 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
93 Jun 12 21:23:41.380 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
94 Jun 12 21:23:41.382 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 2.690913574s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
95 Jun 12 21:23:44.106 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
96 Jun 12 21:23:59.107 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
97 Jun 12 21:23:59.108 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 2.531137895s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
98 Jun 12 21:24:01.664 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
99 Jun 12 21:24:16.625 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
100 Jun 12 21:24:16.627 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 4.014766029s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
101 Jun 12 21:24:20.664 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
102 Jun 12 21:24:35.624 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
103 Jun 12 21:24:35.625 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 15.826911755s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
104 Jun 12 21:24:51.442 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
105 Jun 12 21:25:06.403 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
106 Jun 12 21:25:06.405 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 45.119997939s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
107 Jun 12 21:25:51.432 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
108 Jun 12 21:26:06.393 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
109 Jun 12 21:26:06.394 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 84.447482345s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
110 Jun 12 21:27:33.362 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
111 Jun 12 21:27:48.379 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
112 Jun 12 21:27:48.402 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 133.094237779s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1132024-06-12T21:28:00.800ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:43081 unit = api-server
1142024-06-12T21:28:00.812ZINFOslog-rs: request completed latency_us = 7098 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:43081 req_id = e835618f-4a10-47d0-94df-b532df770114 response_code = 200 unit = api-server uri = /bfd/peers
1152024-06-12T21:28:00.948ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:58996 unit = api-server
1162024-06-12T21:28:00.948ZINFOslog-rs: request completed latency_us = 34 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:58996 req_id = cf4756ff-09d9-432e-b636-9c32ebcb3231 response_code = 200 unit = api-server uri = /bfd/peers
1172024-06-12T21:28:00.985ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:56712 unit = api-server
1182024-06-12T21:28:00.985ZINFOslog-rs: request completed latency_us = 25 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:56712 req_id = bc7d3de8-6196-4d38-9f6d-19f600a982f0 response_code = 200 unit = api-server uri = /bfd/peers
1192024-06-12T21:28:01.672ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:59474 unit = api-server
1202024-06-12T21:28:01.672ZINFOslog-rs: request completed latency_us = 32 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:59474 req_id = ae4fe185-7f7e-4157-a00e-7616f9a91c28 response_code = 200 unit = api-server uri = /bfd/peers
1212024-06-12T21:28:30.701ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:45515 unit = api-server
1222024-06-12T21:28:30.701ZINFOslog-rs: request completed latency_us = 29 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:45515 req_id = 583224b0-ea09-40cf-a3ae-7ea88bd6f314 response_code = 200 unit = api-server uri = /bfd/peers
1232024-06-12T21:28:30.723ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:34775 unit = api-server
1242024-06-12T21:28:30.723ZINFOslog-rs: request completed latency_us = 19 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:34775 req_id = a120dc75-d8f8-4671-9153-d46fc53016f5 response_code = 200 unit = api-server uri = /bfd/peers
1252024-06-12T21:28:30.746ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:35108 unit = api-server
1262024-06-12T21:28:30.746ZINFOslog-rs: request completed latency_us = 13 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:35108 req_id = 78d1c1f6-34da-4ec9-a152-5dc3b90be835 response_code = 200 unit = api-server uri = /bfd/peers
1272024-06-12T21:28:30.915ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:58578 unit = api-server
1282024-06-12T21:28:30.916ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 989 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:58578 req_id = f6945b8d-29a5-4ed2-9ded-ade75458b924 response_code = 500 unit = api-server uri = /static/route4
1292024-06-12T21:28:30.934ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:39438 unit = api-server
1302024-06-12T21:28:30.934ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 15 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:39438 req_id = 6d7cae3c-82e1-4736-a386-46b523d32cb9 response_code = 500 unit = api-server uri = /static/route4
1312024-06-12T21:28:31.071ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:55791 unit = api-server
1322024-06-12T21:28:31.071ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 25 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:55791 req_id = 95d25cda-ee8f-4e45-8b6f-5b32d54bbd88 response_code = 500 unit = api-server uri = /static/route4
1332024-06-12T21:29:00.751ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:39002 unit = api-server
1342024-06-12T21:29:00.751ZINFOslog-rs: request completed latency_us = 34 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:39002 req_id = 164ee996-4303-4d6e-8ee2-fc6691e970ae response_code = 200 unit = api-server uri = /bfd/peers
1352024-06-12T21:29:00.780ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:44500 unit = api-server
1362024-06-12T21:29:00.780ZINFOslog-rs: request completed latency_us = 488 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:44500 req_id = 6a174d11-27fe-4387-8bf8-f7632747d78d response_code = 200 unit = api-server uri = /bfd/peers
1372024-06-12T21:29:00.863ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:60259 unit = api-server
1382024-06-12T21:29:00.863ZINFOslog-rs: request completed latency_us = 20 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:60259 req_id = fe383b3a-98ab-4557-acc7-475017790799 response_code = 200 unit = api-server uri = /bfd/peers
1392024-06-12T21:29:00.949ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:52261 unit = api-server
1402024-06-12T21:29:00.950ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 664 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:52261 req_id = b578e353-75af-473d-9e3f-64d571702fb7 response_code = 500 unit = api-server uri = /static/route4
1412024-06-12T21:29:01.013ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:38384 unit = api-server
1422024-06-12T21:29:01.013ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 590 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:38384 req_id = 25ef012b-1da7-4db7-bedc-3bca66cfddaa response_code = 500 unit = api-server uri = /static/route4
1432024-06-12T21:29:01.126ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:63908 unit = api-server
1442024-06-12T21:29:01.126ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 25 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:63908 req_id = 58635b95-403e-4465-88d8-7e0d038cf2bf response_code = 500 unit = api-server uri = /static/route4
1452024-06-12T21:29:30.676ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:38951 unit = api-server
1462024-06-12T21:29:30.676ZINFOslog-rs: request completed latency_us = 28 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:38951 req_id = e250579d-8765-4378-9cf3-38f759c1b2c1 response_code = 200 unit = api-server uri = /bfd/peers
1472024-06-12T21:29:30.714ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:44848 unit = api-server
1482024-06-12T21:29:30.714ZINFOslog-rs: request completed latency_us = 25 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:44848 req_id = 03516a3e-cfad-4ac4-99ea-a29df44fbd57 response_code = 200 unit = api-server uri = /bfd/peers
1492024-06-12T21:29:30.725ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:39327 unit = api-server
1502024-06-12T21:29:30.725ZINFOslog-rs: request completed latency_us = 23 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:39327 req_id = 2dbf3d5b-d5bc-45dd-b51e-6b3ea67dd041 response_code = 200 unit = api-server uri = /bfd/peers
1512024-06-12T21:29:30.773ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:42996 unit = api-server
1522024-06-12T21:29:30.773ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 26 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:42996 req_id = c5ee818d-d90c-43d8-91f2-965b22d3af20 response_code = 500 unit = api-server uri = /static/route4
1532024-06-12T21:29:30.857ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:52201 unit = api-server
1542024-06-12T21:29:30.857ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 25 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:52201 req_id = 281002dc-24c8-4a94-ba0a-bf1f9c210572 response_code = 500 unit = api-server uri = /static/route4
1552024-06-12T21:29:30.865ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:57634 unit = api-server
1562024-06-12T21:29:30.865ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 18 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:57634 req_id = 8dfb7a0f-93c9-4511-b17c-51b2fd75ab29 response_code = 500 unit = api-server uri = /static/route4
1572024-06-12T21:30:00.874ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:40920 unit = api-server
1582024-06-12T21:30:00.874ZINFOslog-rs: request completed latency_us = 31 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:40920 req_id = 72b77bf8-7917-40a0-bfca-03eae545ef07 response_code = 200 unit = api-server uri = /bfd/peers
1592024-06-12T21:30:00.901ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:42546 unit = api-server
1602024-06-12T21:30:00.901ZINFOslog-rs: request completed latency_us = 24 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:42546 req_id = b635effe-1d37-46b2-b39b-ed74914bb606 response_code = 200 unit = api-server uri = /bfd/peers
1612024-06-12T21:30:01.070ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:60869 unit = api-server
1622024-06-12T21:30:01.070ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 29 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:60869 req_id = 193320fc-4387-4d05-b57e-410185cc9671 response_code = 500 unit = api-server uri = /static/route4
1632024-06-12T21:30:01.081ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:48461 unit = api-server
1642024-06-12T21:30:01.081ZINFOslog-rs: request completed latency_us = 26 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:48461 req_id = c1a98c03-682e-4cff-938c-a6b9b85eafe6 response_code = 200 unit = api-server uri = /bfd/peers
1652024-06-12T21:30:01.128ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:53333 unit = api-server
1662024-06-12T21:30:01.128ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 31 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:53333 req_id = 9146d69f-8265-46fb-a870-473ec8caeedf response_code = 500 unit = api-server uri = /static/route4
1672024-06-12T21:30:01.202ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:59868 unit = api-server
1682024-06-12T21:30:01.202ZINFOslog-rs: request completed error_message_external = Internal Server Error error_message_internal = key must be a string latency_us = 27 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:59868 req_id = 51031d8b-fb6e-443b-b26b-7a0d1686fce3 response_code = 500 unit = api-server uri = /static/route4
169 Jun 12 21:30:01.540 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
170 Jun 12 21:30:01.660 DEBG client response, result: Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "5765b663-1616-4664-a9df-ee78e46fa220", "content-length": "41", "date": "Wed, 12 Jun 2024 21:30:00 GMT"} }), component: producer-registration-task
171 Jun 12 21:30:01.663 DEBG registered with nexus successfully, component: producer-registration-task
172 Jun 12 21:30:01.663 DEBG pausing until time to renew lease, wait_period: 150s, lease_duration: 600s, component: producer-registration-task
173 Jun 12 21:30:02.697 INFO accepted connection, remote_addr: [fd00:1122:3344:101::d]:61631, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0560bed/dropshot/src/server.rs:766
174 Jun 12 21:30:02.711 INFO request completed, latency_us: 13832, response_code: 200, uri: /5d108285-c533-41ea-b0cc-e5d0c70b1583, method: GET, req_id: 29aa922e-823a-488e-adff-6fe13e26e76e, remote_addr: [fd00:1122:3344:101::d]:61631, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0560bed/dropshot/src/server.rs:878