Max level shown:
1 [ Jul 27 14:34:47 Enabled. ]
2 [ Jul 27 14:34:47 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jul 27 14:34:47 Method "start" exited with status 0. ]
4 [ Jul 27 14:34:47 Rereading configuration. ]
5 [ Jul 27 14:34:47 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72022-07-27T14:34:47.436ZINFOSledAgent: Starting mg-ddm service
82022-07-27T14:34:47.436ZINFOSledAgent: Importing mg-ddm service path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
92022-07-27T14:34:47.547ZINFOSledAgent: Setting mg-ddm interface interface = net0/linklocal
102022-07-27T14:34:47.555ZINFOSledAgent: Enabling mg-ddm service
112022-07-27T14:34:47.562ZINFOSledAgent: detecting (real or simulated) SP
122022-07-27T14:34:47.562ZINFOSledAgent: setting up bootstrap agent server
132022-07-27T14:34:47.562ZINFOSledAgent: Ensuring config directory exists path = /var/oxide
142022-07-27T14:34:48.065ZINFOSledAgent (BootstrapAgentServer): Started listening local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
152022-07-27T14:34:48.065ZINFOSledAgent (BootstrapAgent): bootstrap service initializing server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
162022-07-27T14:34:48.065ZINFOSledAgent: Sending prefix to ddmd for advertisement prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:9fb2::, mask: 64 }
172022-07-27T14:34:48.066ZINFOSledAgent (RSS): Injecting RSS configuration: SetupServiceConfig { rack_subnet: fd00:1122:3344:100::, requests: [ HardcodedSledRequest { datasets: [ DatasetEnsureBody { id: 09a9a25f26024e2f963031af9c492c3e, zpool_id: d462a7f7b62840fe80ff4e4189e2d62b, dataset_kind: Crucible, address: [fd00:1122:3344:101::6]:32345, }, DatasetEnsureBody { id: 2713b37a30434ed5aafff38200e45cfb, zpool_id: e4b4dc87ab4649fba4b4d361ae214c03, dataset_kind: Crucible, address: [fd00:1122:3344:101::7]:32345, }, DatasetEnsureBody { id: ffd16cade5d5495e9c594312a3857d91, zpool_id: f4b4dc87ab4649fba4b4d361ae214c03, dataset_kind: Crucible, address: [fd00:1122:3344:101::8]:32345, }, DatasetEnsureBody { id: 4d08fc193d5f4f6b9c48925f8eac7255, zpool_id: d462a7f7b62840fe80ff4e4189e2d62b, dataset_kind: CockroachDb { all_addresses: [ [fd00:1122:3344:101::2]:32221, ], }, address: [fd00:1122:3344:101::2]:32221, }, DatasetEnsureBody { id: a3505b41a592420b84f23d76bf0e0a81, zpool_id: d462a7f7b62840fe80ff4e4189e2d62b, dataset_kind: Clickhouse, address: [fd00:1122:3344:101::5]:8123, }, ], services: [ ServiceRequest { id: e6bff1ff24fb49dca54ec6a350cd4d6c, name: "nexus", addresses: [ fd00:1122:3344:101::3, ], gz_addresses: [], service_type: Nexus { internal_address: [fd00:1122:3344:101::3]:12221, external_address: 192.168.1.20:80, }, }, ServiceRequest { id: 1da65e5b210c4859a7d7200c1e659972, name: "oximeter", addresses: [ fd00:1122:3344:101::4, ], gz_addresses: [], service_type: Oximeter, }, ServiceRequest { id: a0fe5ebc92616f77acc1972481755789, name: "dendrite", addresses: [ fd00:1122:3344:101::9, ], gz_addresses: [], service_type: Dendrite { asic: TofinoStub, }, }, ], dns_services: [], }, ], rack_secret_threshold: 1, }
182022-07-27T14:34:48.066ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet
192022-07-27T14:34:48.072ZINFOSledAgent (RSS): Received prefixes from ddmd prefixes = {}
202022-07-27T14:34:48.073ZINFOSledAgent (RSS): Enough peers exist to enact RSS plan
212022-07-27T14:34:48.073ZINFOSledAgent (RSS): Creating new allocation plan
222022-07-27T14:34:48.073ZINFOSledAgent (RSS): dns_subnets: [ DnsSubnet { subnet: Ipv6Subnet { net: Ipv6Net( Ipv6Network { addr: fd00:1122:3344:1::, prefix: 64, }, ), }, }, ]
232022-07-27T14:34:48.073ZINFOSledAgent (RSS): Serializing plan
242022-07-27T14:34:48.073ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1
252022-07-27T14:34:48.073ZINFOSledAgent (RSS): Plan serialized as: ["[fdb0:18c0:4d0d:9fb2::1]:12346".initialization_request] id = "2d808b5f-cced-417d-883c-f6427182f9c9" rack_id = "b6831956-cfc8-4142-940c-ae26b32e9962" ["[fdb0:18c0:4d0d:9fb2::1]:12346".initialization_request.subnet] net = "fd00:1122:3344:101::/64" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset]] address = "[fd00:1122:3344:101::6]:32345" id = "09a9a25f-2602-4e2f-9630-31af9c492c3e" zpool_id = "d462a7f7-b628-40fe-80ff-4e4189e2d62b" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset.dataset_kind] type = "crucible" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset]] address = "[fd00:1122:3344:101::7]:32345" id = "2713b37a-3043-4ed5-aaff-f38200e45cfb" zpool_id = "e4b4dc87-ab46-49fb-a4b4-d361ae214c03" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset.dataset_kind] type = "crucible" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset]] address = "[fd00:1122:3344:101::8]:32345" id = "ffd16cad-e5d5-495e-9c59-4312a3857d91" zpool_id = "f4b4dc87-ab46-49fb-a4b4-d361ae214c03" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset.dataset_kind] type = "crucible" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset]] address = "[fd00:1122:3344:101::2]:32221" id = "4d08fc19-3d5f-4f6b-9c48-925f8eac7255" zpool_id = "d462a7f7-b628-40fe-80ff-4e4189e2d62b" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset.dataset_kind] all_addresses = ["[fd00:1122:3344:101::2]:32221"] type = "cockroach_db" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset]] address = "[fd00:1122:3344:101::5]:8123" id = "a3505b41-a592-420b-84f2-3d76bf0e0a81" zpool_id = "d462a7f7-b628-40fe-80ff-4e4189e2d62b" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dataset.dataset_kind] type = "clickhouse" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dns_service]] addresses = ["fd00:1122:3344:1::1"] gz_addresses = ["fd00:1122:3344:1::2"] id = "c8794b36-2297-4e6e-8500-23c64ad5a36a" name = "internal-dns" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.dns_service.service_type] dns_address = "[fd00:1122:3344:1::1]:53" server_address = "[fd00:1122:3344:1::1]:5353" type = "internal_dns" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.service]] addresses = ["fd00:1122:3344:101::3"] gz_addresses = [] id = "e6bff1ff-24fb-49dc-a54e-c6a350cd4d6c" name = "nexus" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.service.service_type] external_address = "192.168.1.20:80" internal_address = "[fd00:1122:3344:101::3]:12221" type = "nexus" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.service]] addresses = ["fd00:1122:3344:101::4"] gz_addresses = [] id = "1da65e5b-210c-4859-a7d7-200c1e659972" name = "oximeter" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.service.service_type] type = "oximeter" [["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.service]] addresses = ["fd00:1122:3344:101::9"] gz_addresses = [] id = "a0fe5ebc-9261-6f77-acc1-972481755789" name = "dendrite" ["[fdb0:18c0:4d0d:9fb2::1]:12346".services_request.service.service_type] asic = "tofino_stub" type = "dendrite"
262022-07-27T14:34:48.073ZINFOSledAgent (RSS): Plan written to storage
272022-07-27T14:34:48.073ZINFOSledAgent (RSS): Skipping rack secret creation (only one sled present)
282022-07-27T14:34:48.073ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS request = SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
292022-07-27T14:34:48.073ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
302022-07-27T14:34:48.073ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:51896
312022-07-27T14:34:48.075ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:51896
322022-07-27T14:34:48.076ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
332022-07-27T14:34:48.076ZINFOSledAgent: setting up sled agent server
342022-07-27T14:34:48.076ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
352022-07-27T14:34:48.565ZINFOSledAgent: updating xde driver configuration file for external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
362022-07-27T14:34:48.608ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
372022-07-27T14:34:48.609ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:51896
382022-07-27T14:34:48.609ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:51896
392022-07-27T14:34:48.609ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
402022-07-27T14:34:48.736ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
412022-07-27T14:34:48.736ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:38202
422022-07-27T14:34:48.736ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:38202
432022-07-27T14:34:48.738ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
442022-07-27T14:34:48.738ZINFOSledAgent: setting up sled agent server
452022-07-27T14:34:48.738ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
462022-07-27T14:34:48.766ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
472022-07-27T14:34:48.806ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
482022-07-27T14:34:48.806ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:38202
492022-07-27T14:34:48.806ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:38202
502022-07-27T14:34:48.806ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
512022-07-27T14:34:49.515ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
522022-07-27T14:34:49.515ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37480
532022-07-27T14:34:49.516ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37480
542022-07-27T14:34:49.516ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
552022-07-27T14:34:49.516ZINFOSledAgent: setting up sled agent server
562022-07-27T14:34:49.516ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
572022-07-27T14:34:49.548ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
582022-07-27T14:34:49.589ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
592022-07-27T14:34:49.589ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37480
602022-07-27T14:34:49.589ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37480
612022-07-27T14:34:49.589ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
622022-07-27T14:34:50.404ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
632022-07-27T14:34:50.404ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:60262
642022-07-27T14:34:50.404ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:60262
652022-07-27T14:34:50.405ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
662022-07-27T14:34:50.405ZINFOSledAgent: setting up sled agent server
672022-07-27T14:34:50.406ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
682022-07-27T14:34:50.436ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
692022-07-27T14:34:50.476ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
702022-07-27T14:34:50.476ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:60262
712022-07-27T14:34:50.476ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:60262
722022-07-27T14:34:50.476ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
732022-07-27T14:34:51.636ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
742022-07-27T14:34:51.636ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:39929
752022-07-27T14:34:51.636ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:39929
762022-07-27T14:34:51.636ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
772022-07-27T14:34:51.638ZINFOSledAgent: setting up sled agent server
782022-07-27T14:34:51.638ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
792022-07-27T14:34:51.668ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
802022-07-27T14:34:51.710ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
812022-07-27T14:34:51.710ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:39929
822022-07-27T14:34:51.710ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:39929
832022-07-27T14:34:51.710ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
842022-07-27T14:34:54.851ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
852022-07-27T14:34:54.851ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:41237
862022-07-27T14:34:54.851ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:41237
872022-07-27T14:34:54.851ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
882022-07-27T14:34:54.852ZINFOSledAgent: setting up sled agent server
892022-07-27T14:34:54.853ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
902022-07-27T14:34:54.882ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
912022-07-27T14:34:54.924ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
922022-07-27T14:34:54.924ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:41237
932022-07-27T14:34:54.924ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:41237
942022-07-27T14:34:54.924ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
952022-07-27T14:35:04.552ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
962022-07-27T14:35:04.552ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:36856
972022-07-27T14:35:04.552ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:36856
982022-07-27T14:35:04.552ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
992022-07-27T14:35:04.552ZINFOSledAgent: setting up sled agent server
1002022-07-27T14:35:04.553ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1012022-07-27T14:35:04.587ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1022022-07-27T14:35:04.629ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1032022-07-27T14:35:04.629ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:36856
1042022-07-27T14:35:04.629ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:36856
1052022-07-27T14:35:04.630ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
1062022-07-27T14:35:16.531ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
1072022-07-27T14:35:16.531ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:53312
1082022-07-27T14:35:16.531ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:53312
1092022-07-27T14:35:16.531ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1102022-07-27T14:35:16.531ZINFOSledAgent: setting up sled agent server
1112022-07-27T14:35:16.531ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1122022-07-27T14:35:16.564ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1132022-07-27T14:35:16.606ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1142022-07-27T14:35:16.606ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:53312
1152022-07-27T14:35:16.607ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:53312
1162022-07-27T14:35:16.607ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
1172022-07-27T14:35:59.955ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
1182022-07-27T14:35:59.955ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37585
1192022-07-27T14:35:59.955ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37585
1202022-07-27T14:35:59.955ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1212022-07-27T14:35:59.955ZINFOSledAgent: setting up sled agent server
1222022-07-27T14:35:59.955ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1232022-07-27T14:35:59.989ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1242022-07-27T14:36:00.031ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1252022-07-27T14:36:00.031ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37585
1262022-07-27T14:36:00.031ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37585
1272022-07-27T14:36:00.031ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
1282022-07-27T14:37:03.529ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
1292022-07-27T14:37:03.529ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:48249
1302022-07-27T14:37:03.529ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:48249
1312022-07-27T14:37:03.529ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1322022-07-27T14:37:03.529ZINFOSledAgent: setting up sled agent server
1332022-07-27T14:37:03.529ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1342022-07-27T14:37:03.562ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1352022-07-27T14:37:03.605ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1362022-07-27T14:37:03.605ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:48249
1372022-07-27T14:37:03.605ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:48249
1382022-07-27T14:37:03.605ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
1392022-07-27T14:38:09.401ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
1402022-07-27T14:38:09.401ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63057
1412022-07-27T14:38:09.401ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63057
1422022-07-27T14:38:09.402ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1432022-07-27T14:38:09.402ZINFOSledAgent: setting up sled agent server
1442022-07-27T14:38:09.402ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1452022-07-27T14:38:09.434ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1462022-07-27T14:38:09.477ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1472022-07-27T14:38:09.477ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63057
1482022-07-27T14:38:09.477ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63057
1492022-07-27T14:38:09.477ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")
1502022-07-27T14:40:48.092ZINFOSledAgent (BootstrapAgentRssHandler): No SP available; proceeding without sprockets auth BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346
1512022-07-27T14:40:48.092ZINFOSledAgent (BootstrapAgentServer): Accepted connection remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58696
1522022-07-27T14:40:48.092ZINFOSledAgent (BootstrapAgentServer): No SP available; proceeding without sprockets auth remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58696
1532022-07-27T14:40:48.092ZINFOSledAgent (BootstrapAgent): Loading Sled Agent: SledAgentRequest { id: 2d808b5f-cced-417d-883c-f6427182f9c9, rack_id: b6831956-cfc8-4142-940c-ae26b32e9962, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } server = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1542022-07-27T14:40:48.092ZINFOSledAgent: setting up sled agent server
1552022-07-27T14:40:48.092ZINFOSledAgent: created sled agent sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1562022-07-27T14:40:48.125ZINFOSledAgent: xde driver configuration file appears to already use external IP workaround conf_file = "/kernel/drv/xde.conf" sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1572022-07-27T14:40:48.168ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "linklocal" }, AddrObject { interface: "net1", name: "linklocal" }]' as data links for xde driver sled_id = fb0f7546-4d46-40ca-9d56-cbb810684ca7
1582022-07-27T14:40:48.168ZWARNSledAgent (BootstrapAgentServer): Sled agent request failed err = Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 } remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58696
1592022-07-27T14:40:48.168ZINFOSledAgent (BootstrapAgentServer): Connection closed remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58696
1602022-07-27T14:40:48.168ZWARNSledAgent (BootstrapAgentRssHandler): failed to start sled agent error = ServerFailure("Sled agent request failed: Error starting sled agent: Could not start sled agent server: Error managing guest networking: Failure interacting with the OPTE ioctl(2) interface: command SetXdeUnderlay failed: BadApiVersion { user: 6, kernel: 5 }")