Max level shown:
1 [ Nov 7 02:39:25 Disabled. ]
2 [ Nov 7 02:39:25 Rereading configuration. ]
3 [ Nov 7 02:39:26 Enabled. ]
4 [ Nov 7 02:39:26 Rereading configuration. ]
5 [ Nov 7 02:39:26 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mgd/pkg/mgd_method_script.sh &"). ]
6 [ Nov 7 02:39:26 Method "start" exited with status 0. ]
72024-11-07T02:39:26.964ZINFOslog-rs: signal handler waiting for context
82024-11-07T02:39:26.985ZINFOslog-rs: signal handler waiting got context
92024-11-07T02:39:26.985ZINFOslog-rs: bgp routers: {}
102024-11-07T02:39:26.985ZINFOslog-rs: bfd peers: []
112024-11-07T02:39:26.986ZERROslog-rs: failed to start stats server: underlay address not found
122024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bfd/peers unit = api-server
132024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bfd/peers unit = api-server
142024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bfd/peers/{addr} unit = api-server
152024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/checker unit = api-server
162024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/checker unit = api-server
172024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/checker unit = api-server
182024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/checker unit = api-server
192024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/neighbor unit = api-server
202024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/neighbor unit = api-server
212024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/neighbor unit = api-server
222024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/neighbor unit = api-server
232024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/neighbors unit = api-server
242024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/origin4 unit = api-server
252024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/origin4 unit = api-server
262024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/origin4 unit = api-server
272024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/origin4 unit = api-server
282024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/router unit = api-server
292024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/router unit = api-server
302024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/router unit = api-server
312024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/router unit = api-server
322024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/routers unit = api-server
332024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/shaper unit = api-server
342024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/shaper unit = api-server
352024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/shaper unit = api-server
362024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/shaper unit = api-server
372024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/message-history unit = api-server
382024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/omicron/apply unit = api-server
392024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/exported unit = api-server
402024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/imported unit = api-server
412024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/neighbors unit = api-server
422024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/selected unit = api-server
432024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /static/route4 unit = api-server
442024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /static/route4 unit = api-server
452024-11-07T02:39:26.990ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /static/route4 unit = api-server
462024-11-07T02:39:26.990ZINFOslog-rs: admin: listening on [::]:4676
472024-11-07T02:39:26.990ZINFOslog-rs: listening local_addr = [::]:4676 unit = api-server
482024-11-07T02:39:26.991ZDEBGslog-rs: successfully registered DTrace USDT probes local_addr = [::]:4676 unit = api-server
492024-11-07T02:39:27.066ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
502024-11-07T02:39:28.067ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
512024-11-07T02:39:29.068ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
522024-11-07T02:39:30.069ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
532024-11-07T02:39:31.069ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
542024-11-07T02:39:32.070ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
552024-11-07T02:39:33.070ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
562024-11-07T02:39:34.071ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
572024-11-07T02:39:35.072ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
582024-11-07T02:39:36.075ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
592024-11-07T02:39:37.075ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
602024-11-07T02:39:38.075ZWARNslog-rs: failed to ensure TEP address fde1:860d:465f:8cab::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6)
61 [ Nov 7 02:39:38 Rereading configuration. ]
62 [ Nov 7 02:39:38 Executing refresh method ("/opt/oxide/mgd/pkg/refresh_ctrun_child.sh -c 213"). ]
63 + CONTRACT=''
64 + getopts c: o
65 + CONTRACT=213
66 + getopts c: o
67 + [[ -n 213 ]]
68 + pgrep -c 213
69 + PARENT_PID=2293
70 + [[ -n 2293 ]]
71 + pgrep -P 2293
72 + CHILD_PID=2294
73 + [[ -n 2294 ]]
74 + kill -USR1 2294
752024-11-07T02:39:38.229ZINFOslog-rs: handling smf refresh
762024-11-07T02:39:38.230ZINFOslog-rs: starting stats server on smf refresh
77 [ Nov 7 02:39:38 Method "refresh" exited with status 0. ]
78 Nov 07 02:39:38.231 DEBG registered DTrace probes
79 Nov 07 02:39:38.231 DEBG registered endpoint, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
80 Nov 07 02:39:38.231 INFO listening, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197
81 Nov 07 02:39:38.231 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
82 Nov 07 02:39:38.232 DEBG Nexus IP not provided, will use DNS to resolve it
83 Nov 07 02:39:38.232 INFO new DNS resolver, addresses: [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53], component: internal-dns-resolver, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/internal-dns/src/resolver.rs:72
84 Nov 07 02:39:38.232 DEBG starting producer registration task
85 Nov 07 02:39:38.232 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:4677, producer_id: 78c60873-866e-47ae-8fa0-37dbc6c5eff6, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:283
86 Nov 07 02:39:38.232 DEBG registering / renewing oximeter producer lease with Nexus, component: producer-registration-task
872024-11-07T02:39:38.918ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::1]:43896 unit = api-server
882024-11-07T02:39:38.918ZINFOslog-rs: request completed latency_us = 437 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::1]:43896 req_id = 69285c26-e87d-46a4-920d-f54bbc42920d response_code = 204 unit = api-server uri = /static/route4
892024-11-07T02:39:38.919ZERROslog-rs: handling change failed: libnet error route io error No such process (os error 3)
902024-11-07T02:39:38.919ZINFOslog-rs: restarting sync loop
91 Nov 07 02:39:48.236 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0d502811-de24-4e27-b92c-fccb5bf9f798.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("585aaa98-c3b7-4a1f-979c-2088fe719dd8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cfce6b5d-973c-4736-93fb-e3347600566b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cfce6b5d-973c-4736-93fb-e3347600566b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::c))) }], valid_until: Instant { tv_sec: 803, tv_nsec: 109355695 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
92 Nov 07 02:39:48.237 DEBG using nexus address for registration, addr: [fd00:1122:3344:101::a]:12221, component: producer-registration-task
93 Nov 07 02:39:48.269 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
94 Nov 07 02:40:03.394 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
95 Nov 07 02:40:03.395 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 135.283435ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
96 Nov 07 02:40:03.560 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
97 Nov 07 02:40:18.521 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
98 Nov 07 02:40:18.522 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 490.755198ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
99 Nov 07 02:40:19.043 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
100 Nov 07 02:40:34.003 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
101 Nov 07 02:40:34.004 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 666.572318ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
102 Nov 07 02:40:34.700 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
103 Nov 07 02:40:49.661 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
104 Nov 07 02:40:49.662 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 1.993664731s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
105 Nov 07 02:40:51.684 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
106 Nov 07 02:41:06.645 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
107 Nov 07 02:41:06.647 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 5.401504277s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
108 Nov 07 02:41:12.064 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
109 Nov 07 02:41:27.025 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
110 Nov 07 02:41:27.026 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 10.122951265s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
111 Nov 07 02:41:37.154 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
112 Nov 07 02:41:52.115 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
113 Nov 07 02:41:52.116 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 8.300836854s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
114 Nov 07 02:42:00.433 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
115 Nov 07 02:42:15.430 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
116 Nov 07 02:42:15.431 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 26.121363174s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
117 Nov 07 02:42:41.608 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
118 Nov 07 02:42:56.609 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
119 Nov 07 02:42:56.613 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)", delay: 88.945860341s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/48125c8/oximeter/producer/src/lib.rs:424
1202024-11-07T02:43:32.168ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:58279 unit = api-server
1212024-11-07T02:43:32.169ZINFOslog-rs: request completed latency_us = 647 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:58279 req_id = 2c280fea-cb2f-4b66-9917-99516075f259 response_code = 200 unit = api-server uri = /bfd/peers
1222024-11-07T02:43:33.220ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:34174 unit = api-server
1232024-11-07T02:43:33.220ZINFOslog-rs: request completed latency_us = 31 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:34174 req_id = a1a38e8d-ddcd-4d3b-9c4b-cfb523ef14d7 response_code = 200 unit = api-server uri = /bfd/peers
1242024-11-07T02:43:33.274ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:33521 unit = api-server
1252024-11-07T02:43:33.274ZINFOslog-rs: request completed latency_us = 29 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:33521 req_id = 469846b4-753a-412c-a958-86bc94886fdc response_code = 200 unit = api-server uri = /bfd/peers
1262024-11-07T02:44:02.307ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:54101 unit = api-server
1272024-11-07T02:44:02.307ZINFOslog-rs: request completed latency_us = 32 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:54101 req_id = 8aab95fe-20f8-4e78-a5f1-dd99dfcbd73d response_code = 200 unit = api-server uri = /bfd/peers
1282024-11-07T02:44:02.461ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:65151 unit = api-server
1292024-11-07T02:44:02.462ZINFOslog-rs: request completed latency_us = 528 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:65151 req_id = b48b87de-e135-4828-a5a3-9c59d35532d6 response_code = 200 unit = api-server uri = /static/route4
1302024-11-07T02:44:02.462ZINFOslog-rs: request completed latency_us = 493 local_addr = [::]:4676 method = DELETE remote_addr = [fd00:1122:3344:101::a]:65151 req_id = e8d6d4bf-613e-4db3-b60b-90b5ee2e6457 response_code = 204 unit = api-server uri = /static/route4
1312024-11-07T02:44:02.463ZINFOslog-rs: request completed latency_us = 644 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::a]:65151 req_id = 370a4db9-54fa-4318-a644-c413bc3e9451 response_code = 204 unit = api-server uri = /static/route4
1322024-11-07T02:44:03.113ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:46869 unit = api-server
1332024-11-07T02:44:03.113ZINFOslog-rs: request completed latency_us = 29 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:46869 req_id = 0df8b95a-621b-4c71-b648-c9b65deae8e0 response_code = 200 unit = api-server uri = /bfd/peers
1342024-11-07T02:44:03.267ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:60285 unit = api-server
1352024-11-07T02:44:03.267ZINFOslog-rs: request completed latency_us = 37 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:60285 req_id = 91026f59-1547-48e0-8446-d8b54e1cf2ce response_code = 200 unit = api-server uri = /static/route4
1362024-11-07T02:44:03.270ZINFOslog-rs: request completed latency_us = 81 local_addr = [::]:4676 method = DELETE remote_addr = [fd00:1122:3344:101::b]:60285 req_id = 54555f58-bf52-476c-b3e2-a67bca7a9ab8 response_code = 204 unit = api-server uri = /static/route4
1372024-11-07T02:44:03.270ZINFOslog-rs: request completed latency_us = 90 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::b]:60285 req_id = 03ab3f72-a9fa-4e62-9b3a-978aef4d8767 response_code = 204 unit = api-server uri = /static/route4
1382024-11-07T02:44:03.310ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:58361 unit = api-server
1392024-11-07T02:44:03.310ZINFOslog-rs: request completed latency_us = 23 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:58361 req_id = 854497b0-2663-414d-b48e-6a3fba082e84 response_code = 200 unit = api-server uri = /bfd/peers
1402024-11-07T02:44:03.545ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:44068 unit = api-server
1412024-11-07T02:44:03.545ZINFOslog-rs: request completed latency_us = 33 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:44068 req_id = a797d326-729c-413f-a2c1-7cf1a4c6fdc8 response_code = 200 unit = api-server uri = /static/route4
1422024-11-07T02:44:03.546ZINFOslog-rs: request completed latency_us = 82 local_addr = [::]:4676 method = DELETE remote_addr = [fd00:1122:3344:101::c]:44068 req_id = 58a1bf07-fb5d-4caa-8a8f-c66fadb8e281 response_code = 204 unit = api-server uri = /static/route4
1432024-11-07T02:44:03.546ZINFOslog-rs: request completed latency_us = 93 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::c]:44068 req_id = fd8490f1-b255-4c22-b0ec-5d2fcf966a93 response_code = 204 unit = api-server uri = /static/route4
144 Nov 07 02:44:25.592 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
145 Nov 07 02:44:25.600 DEBG client response, result: Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f1007884-a927-441e-a9ce-5482e2e4379f", "content-length": "41", "date": "Thu, 07 Nov 2024 02:44:25 GMT"} }), component: producer-registration-task
146 Nov 07 02:44:25.601 DEBG registered with nexus successfully, component: producer-registration-task
147 Nov 07 02:44:25.601 DEBG pausing until time to renew lease, wait_period: 150s, lease_duration: 600s, component: producer-registration-task
1482024-11-07T02:44:32.379ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:39729 unit = api-server
1492024-11-07T02:44:32.379ZINFOslog-rs: request completed latency_us = 26 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:39729 req_id = 13c4c68c-04d7-42e4-aa22-3898c7b5d649 response_code = 200 unit = api-server uri = /bfd/peers
1502024-11-07T02:44:32.642ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::a]:60131 unit = api-server
1512024-11-07T02:44:32.642ZINFOslog-rs: request completed latency_us = 30 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::a]:60131 req_id = 40f92584-f2a0-4d6e-aab4-44f02cc3d5ad response_code = 200 unit = api-server uri = /static/route4
1522024-11-07T02:44:32.642ZINFOslog-rs: request completed latency_us = 68 local_addr = [::]:4676 method = DELETE remote_addr = [fd00:1122:3344:101::a]:60131 req_id = 5c8b9612-f03d-4813-93a7-9ace1cb97020 response_code = 204 unit = api-server uri = /static/route4
1532024-11-07T02:44:32.642ZINFOslog-rs: request completed latency_us = 104 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::a]:60131 req_id = 50641b18-3535-443c-a27b-017cb306cbb9 response_code = 204 unit = api-server uri = /static/route4
1542024-11-07T02:44:33.238ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:46595 unit = api-server
1552024-11-07T02:44:33.238ZINFOslog-rs: request completed latency_us = 28 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:46595 req_id = b5b0b20b-8bb3-4922-a798-d229a533523f response_code = 200 unit = api-server uri = /bfd/peers
1562024-11-07T02:44:33.241ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:59506 unit = api-server
1572024-11-07T02:44:33.241ZINFOslog-rs: request completed latency_us = 17 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:59506 req_id = f63aacc4-87fd-441e-aafe-189c6748fbaf response_code = 200 unit = api-server uri = /bfd/peers
1582024-11-07T02:44:33.483ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::c]:32979 unit = api-server
1592024-11-07T02:44:33.483ZINFOslog-rs: request completed latency_us = 33 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::c]:32979 req_id = 5ae5128b-b092-4568-bb80-4304442a64c3 response_code = 200 unit = api-server uri = /static/route4
1602024-11-07T02:44:33.483ZINFOslog-rs: request completed latency_us = 97 local_addr = [::]:4676 method = DELETE remote_addr = [fd00:1122:3344:101::c]:32979 req_id = 3f087cfb-d5d2-4ff5-9526-eb35ab94c36e response_code = 204 unit = api-server uri = /static/route4
1612024-11-07T02:44:33.484ZINFOslog-rs: request completed latency_us = 112 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::c]:32979 req_id = 6639c108-d98a-41e9-93b9-744297d38d97 response_code = 204 unit = api-server uri = /static/route4
1622024-11-07T02:44:33.937ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::b]:46227 unit = api-server
1632024-11-07T02:44:33.938ZINFOslog-rs: request completed latency_us = 50 local_addr = [::]:4676 method = GET remote_addr = [fd00:1122:3344:101::b]:46227 req_id = eea8db04-311f-48c8-9cdd-dce0cc4a9679 response_code = 200 unit = api-server uri = /static/route4
1642024-11-07T02:44:33.938ZINFOslog-rs: request completed latency_us = 89 local_addr = [::]:4676 method = DELETE remote_addr = [fd00:1122:3344:101::b]:46227 req_id = 103a2719-c8a6-4468-a734-e3174237f34d response_code = 204 unit = api-server uri = /static/route4
1652024-11-07T02:44:33.938ZINFOslog-rs: request completed latency_us = 90 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::b]:46227 req_id = 87c0a594-e423-4ff0-8e11-edaa66a91550 response_code = 204 unit = api-server uri = /static/route4
166 Nov 07 02:44:39.908 INFO accepted connection, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105
167 Nov 07 02:44:39.915 INFO request completed, latency_us: 6241, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 243fe4fb-3244-4762-b198-c6f8e2f29117, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
168 Nov 07 02:44:40.908 INFO request completed, latency_us: 310, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 9682b1be-d639-43c6-bfed-da3cc82e746f, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
169 Nov 07 02:44:41.908 INFO request completed, latency_us: 308, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 2f9d11f7-55b3-48f4-9331-bc16e0d5c320, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
170 Nov 07 02:44:42.908 INFO request completed, latency_us: 358, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 6c60c044-56ab-45b8-b3ef-72b5c223156e, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
171 Nov 07 02:44:43.908 INFO request completed, latency_us: 522, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 44222beb-21c3-4845-a959-45c12fd1ea0e, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
172 Nov 07 02:44:44.908 INFO request completed, latency_us: 576, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 2f2f8449-dbba-440e-9a2f-33d2b0e15902, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
173 Nov 07 02:44:45.908 INFO request completed, latency_us: 409, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 685f7c14-47ad-4dc0-98d2-8e8415f26ab1, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
174 Nov 07 02:44:46.908 INFO request completed, latency_us: 359, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 162b9813-3fa4-48a5-8f1a-22bf9f8d6baf, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
175 Nov 07 02:44:47.908 INFO request completed, latency_us: 354, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 581ad96f-fd8b-42be-b351-deffeb0769cd, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
176 Nov 07 02:44:48.909 INFO request completed, latency_us: 534, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 5e153002-3243-4ec8-a93e-eaab4580fde0, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
177 Nov 07 02:44:49.908 INFO request completed, latency_us: 360, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: bd87d4c4-49ae-43ad-a513-d98b86d2d7d0, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
178 Nov 07 02:44:50.909 INFO request completed, latency_us: 539, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: da1544b1-394d-43d1-a948-25004161d42b, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
179 Nov 07 02:44:51.909 INFO request completed, latency_us: 543, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 451828b3-6a30-47d9-8af1-289485bdfba6, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
180 Nov 07 02:44:52.908 INFO request completed, latency_us: 543, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: af0d784c-7f61-468b-a65b-c02b5ab436df, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
181 Nov 07 02:44:53.908 INFO request completed, latency_us: 513, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 9f104d07-5430-469f-85bb-385308df4a6d, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
182 Nov 07 02:44:54.909 INFO request completed, latency_us: 313, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: a8515372-2221-4794-aa69-39924e4d055c, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
183 Nov 07 02:44:55.950 INFO request completed, latency_us: 327, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 01dd89e7-e0fe-4638-a946-516bac5a3ae7, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
184 Nov 07 02:44:56.950 INFO request completed, latency_us: 441, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 4daa0af2-23c3-4bf3-87fd-5cb4ff5dbb78, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
185 Nov 07 02:44:57.950 INFO request completed, latency_us: 437, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 164407af-3ec9-4aae-ba03-26661965a9de, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
186 Nov 07 02:44:58.949 INFO request completed, latency_us: 368, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: 0a7c6856-b98f-4f10-956d-d50d8efa65c0, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950
187 Nov 07 02:44:59.950 INFO request completed, latency_us: 466, response_code: 200, uri: /78c60873-866e-47ae-8fa0-37dbc6c5eff6, method: GET, req_id: a0270470-2ab0-44e9-89d5-fe5f9f678f3c, remote_addr: [fd00:1122:3344:101::d]:38614, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950